-- Logs begin at Tue 2022-07-12 02:11:58 UTC, end at Tue 2022-07-12 04:13:57 UTC. -- Jul 12 03:40:21.068313 dv-cinder-847730-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 03:40:21.084965 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 03:40:21 2022] *** Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: nodename: dv-cinder-847730-4-iscsi Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: machine: x86_64 Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: clock source: unix Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: pcre jit disabled Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: detected number of CPU cores: 4 Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: current working directory: / Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: detected binary path: /usr/bin/uwsgi-core Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: your processes number limit is 47680 Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: your memory page size is 4096 bytes Jul 12 03:40:21.086990 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: detected max file descriptor number: 2048 Jul 12 03:40:21.087728 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: lock engine: pthread robust mutexes Jul 12 03:40:21.087728 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: thunder lock: enabled Jul 12 03:40:21.087728 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 03:40:21.087728 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 03:40:21.129999 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: Python main interpreter initialized at 0x55e51988c9c0 Jul 12 03:40:21.129999 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: python threads support enabled Jul 12 03:40:21.129999 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: your server socket listen backlog is limited to 100 connections Jul 12 03:40:21.129999 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: your mercy for graceful operations on workers is 90 seconds Jul 12 03:40:21.130361 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 03:40:21.130361 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: *** Operational MODE: preforking *** Jul 12 03:40:21.130659 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: *** uWSGI is running in multiple interpreter mode *** Jul 12 03:40:21.130659 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: spawned uWSGI master process (pid: 109898) Jul 12 03:40:21.130875 dv-cinder-847730-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 03:40:21.132325 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: spawned uWSGI worker 1 (pid: 109899, cores: 1) Jul 12 03:40:21.132325 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: spawned uWSGI worker 2 (pid: 109900, cores: 1) Jul 12 03:40:21.132325 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 03:40:21.776530 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 03:40:21.778823 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 03:40:22.884315 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 03:40:22.884315 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: from cryptography.utils import int_from_bytes Jul 12 03:40:22.885068 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 03:40:22.885068 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: from cryptography.utils import int_from_bytes Jul 12 03:40:22.885481 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 03:40:22.885481 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: from cryptography.utils import int_from_bytes Jul 12 03:40:22.885600 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 03:40:22.885600 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: from cryptography.utils import int_from_bytes Jul 12 03:40:25.330928 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 03:40:25.331550 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 03:40:25.331651 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 03:40:25.332036 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 03:40:25.332304 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 03:40:25.332688 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.333004 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.333318 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.333637 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.334014 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.334322 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.334639 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.334935 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.335255 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.335486 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 03:40:25.335874 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.335947 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 03:40:25.336118 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.336118 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847730-4-iscsi {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.336374 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 03:40:25.336503 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.336629 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 03:40:25.336751 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.336869 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 03:40:25.336998 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.337234 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.337371 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.337556 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.337683 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.337873 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.338081 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.338210 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.338331 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.338488 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.338614 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.338798 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.340023 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.340222 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.340379 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.340555 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.340772 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.340959 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.340959 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.341276 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.341276 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.341578 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.341789 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.341981 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847730-4-iscsi {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.342169 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.342362 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.342515 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.342718 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.342903 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.343057 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.343260 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.343408 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.343408 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.343758 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847730-4-iscsi {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.343931 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.344111 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.344324 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.344516 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.344516 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.344803 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.344966 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.345090 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.345247 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.345380 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.345539 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.345661 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.345785 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.345917 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.346045 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.346167 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.346312 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.346439 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.346565 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.346692 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.346823 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.346961 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.347089 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.347221 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.347350 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.347470 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.347618 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.347740 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847730-4-iscsi {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.347873 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.348020 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.348143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.348275 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.348402 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.348522 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.348650 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.348771 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.348904 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.348904 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.349140 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.349268 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.349396 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.349524 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.349644 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.349769 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.349889 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.350017 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.350141 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.350325 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.350457 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.350577 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.350706 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.350838 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.350998 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.351120 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.351263 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.351392 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.351525 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.351679 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.351800 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.351920 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.352055 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.352174 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.352307 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.352430 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.352549 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.352668 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.352793 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.352926 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.353055 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.353181 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.353303 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.353423 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.353541 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.353668 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.353797 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.353917 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.354037 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.354158 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.354285 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.354419 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.354550 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.354550 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.354784 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.354784 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.355019 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.355147 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.355267 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.355385 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.355505 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.355623 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.355750 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.355878 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.356017 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.356190 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.356329 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.356486 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.356629 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.356784 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.356912 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.357103 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.357280 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.357411 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.357558 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.357691 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.357813 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.358005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.358195 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.358344 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.358468 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.358589 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.358711 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.358840 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.358960 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.359089 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.359210 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.359338 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.359459 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.359663 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.359844 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.360036 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.360180 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.360305 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.360424 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.360555 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.360677 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.360815 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.361030 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.361211 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.361354 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.361480 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.361613 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.361737 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.361868 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.361997 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.362201 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.362379 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.362595 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.362721 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.362841 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.362962 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.363081 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.363199 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.363342 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.363464 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.363591 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.363711 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.363883 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.364087 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.364227 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.364349 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.364468 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.364586 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.364794 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.365089 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.365238 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.365364 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.365494 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.365615 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.365734 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.365852 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.365981 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.366115 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.366283 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.366403 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.366522 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.366646 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.366864 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.367045 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.367190 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.367317 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.367438 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.367568 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.367689 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.367807 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.368032 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.368209 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.368341 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.368489 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.368614 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.368732 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.368893 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.369032 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.369180 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.369316 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.369513 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.369705 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.369838 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.369961 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.370082 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.370219 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.370340 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.370466 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.370594 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.370728 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.370888 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.371028 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.371172 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.371302 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.371517 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.371694 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.371826 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.371963 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.372162 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.372286 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.372414 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.372543 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.372674 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.372796 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.372999 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.373177 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.373317 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.373440 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.373574 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.373706 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.373827 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.373946 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.374160 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.374338 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.374490 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.374618 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.374739 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.374866 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.374987 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.375153 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.375284 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.375488 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.375677 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.375811 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.375935 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.376097 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.376222 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.376377 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.376509 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.376704 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.376881 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.377033 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.377159 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.377280 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.377399 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.377600 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.377779 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:40:25.377929 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.378055 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.378175 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.378302 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.378499 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.378693 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.378834 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.378960 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.379080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.379200 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.379392 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.379592 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.379728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.379851 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.379993 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.380181 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.380318 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.380447 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.380642 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.380773 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.380981 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.381118 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.381253 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.381383 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.381587 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.381724 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.381893 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.382034 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.382204 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.382411 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.382535 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.382655 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.382783 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.382904 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.383095 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.383232 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.383410 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.383544 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.383714 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.383841 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.384034 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.384177 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.384350 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.384477 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.384652 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.384778 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.384956 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.385084 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.385254 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.385381 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.385554 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.385681 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.386233 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.386362 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.386542 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.386670 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.386843 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.386970 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.387134 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.387270 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.387449 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.387574 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.387745 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.387869 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.388044 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.388171 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.388354 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.388491 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.388641 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.388776 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.388946 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.389074 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.389242 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.389369 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.389545 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.389681 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.389804 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.389923 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.390129 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.390259 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.390445 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.390581 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.390732 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.390859 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.391064 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.391192 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.391367 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.391509 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.391639 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.391758 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.391959 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.392108 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.392274 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.392403 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.392584 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.392710 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.392884 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.393009 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.393196 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.393326 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.393453 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.393573 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.393770 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.393896 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.394076 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.394202 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.394373 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.394498 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.394677 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.394817 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.394956 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.395078 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.395258 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.395386 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.395562 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.395698 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.395859 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.395994 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.396253 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.396384 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.396551 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.396692 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.396823 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.396946 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.397141 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.397266 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.397450 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.397585 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.397724 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.397910 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.398036 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.398155 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.398342 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.398486 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.398638 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.398765 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.398949 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.399083 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.399265 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.399393 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.399552 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.399679 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.399858 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.399984 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.400196 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.400318 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.400438 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.400564 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.400750 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.400879 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.401038 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.401176 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.401352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.401479 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.401630 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.401758 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.401940 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.402077 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.402207 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.402328 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.402512 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.402648 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.402801 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.402937 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.403119 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.403254 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.403406 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.403547 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.403682 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.403813 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.403983 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.404134 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.404296 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.404439 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.404637 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.404778 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.404903 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.405022 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.405249 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.405385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.405544 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.405677 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.405859 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.405987 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.406149 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.406277 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.406457 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.406584 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.406757 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.406891 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.407046 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.407179 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.407352 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.407478 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.407650 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.407792 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.407929 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.408082 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.408268 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.408404 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.408581 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.408710 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.408839 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.408967 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.409168 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.409293 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.409477 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.409611 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.409786 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.409922 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.410055 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.410176 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.410369 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.410576 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.410707 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.410828 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.410980 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.411110 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.411314 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.411451 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.411622 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.411747 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.411957 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.412138 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.412258 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.412394 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.412563 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.412688 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.412864 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.412988 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.413168 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.413302 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.413470 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.413594 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.413772 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.413895 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.414086 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.414212 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.414390 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.414512 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.414698 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.414820 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.414995 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.415118 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.415305 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.415429 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.415602 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.415725 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.415910 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.416053 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.416231 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.416358 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.416537 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.416661 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.416857 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.416982 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.417173 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.417295 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.417473 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.417608 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.417774 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.417899 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.418079 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.418200 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.418381 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.418513 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.418686 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.418810 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.418989 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.419113 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.419289 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.419423 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.419591 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.419714 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.419892 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.420039 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.420221 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.420363 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.420524 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.420648 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.420825 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.420947 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.421120 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.421243 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.421425 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.421549 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.421724 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.421848 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.422023 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.422148 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.422320 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.422445 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.422623 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.422747 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.422937 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.423062 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.423237 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.423361 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.423543 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.423674 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.423845 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.423977 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.424165 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.424288 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.424462 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.424597 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.424774 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.424900 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.425076 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.425204 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.425370 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.425501 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.425666 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.425791 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.425961 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.426091 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.426264 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.426394 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.426565 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.426692 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.426860 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.427003 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.427163 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.427293 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.427532 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.427667 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.427837 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.427962 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.428171 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.428307 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.428475 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.428606 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.428777 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.428899 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.429079 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.429204 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.429385 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.429506 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.429685 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.429809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.429980 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.430103 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.430278 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.430400 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.430574 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.430697 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.430872 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.430995 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.431186 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.431309 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.431488 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.431621 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.431803 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.431937 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.432091 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.432213 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.432386 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.432519 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.432688 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.432811 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.432994 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.433119 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.433310 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.433552 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.433686 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.433888 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.434011 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.434203 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.434326 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.434508 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.434630 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.434812 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.434935 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.435118 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.435250 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.435424 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.435555 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.435742 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.435865 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.436067 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.436213 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.436376 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.436582 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.436705 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.436825 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.436967 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.437090 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.437264 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.437387 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.437571 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.437702 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.437870 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.438128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.438260 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.438457 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.438579 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.438761 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.438886 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.439059 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.439191 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.439357 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.439480 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.439656 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.439787 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.439955 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.440113 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.440287 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.440410 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.440583 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.440706 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.440890 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.441023 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.441187 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.441319 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.441500 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.441624 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.441802 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.441934 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.442100 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.442225 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.442394 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.442524 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.442689 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.442821 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.443020 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.443137 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.443327 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.443450 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.443628 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.443761 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.443931 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.444072 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.444263 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.444399 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.444565 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.444703 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.444878 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.445000 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.445180 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.445315 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.445480 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.445611 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.445782 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.445905 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.446079 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.446202 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.446384 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.446510 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.446681 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.446803 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.446974 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.447096 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.447271 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.447395 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.447570 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.447706 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.447871 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.447994 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.448195 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.448320 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.448490 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.448613 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.448792 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.448923 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.449089 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.449213 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.449393 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.449528 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.449693 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.449827 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.449992 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.450114 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.450286 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.450410 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.450589 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.450726 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.450889 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.451056 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.451179 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.451298 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.451472 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.451604 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.451758 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.451887 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.452080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.452205 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.452381 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.452517 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.452678 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.452805 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.452975 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.453098 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.453274 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.453398 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.453572 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.453694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.453867 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.453990 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.454169 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.454293 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.454471 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.454606 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.454769 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.454899 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.455065 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.455192 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.455364 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.455486 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.455658 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.455779 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.455954 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.456102 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.456276 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.456398 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.456589 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.456724 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.456890 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.457013 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.457183 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.457313 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.457484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.457616 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.457776 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.457899 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.458074 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.458197 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.458369 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.458502 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.458716 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.458841 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.459013 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.459144 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.459308 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.459441 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.459605 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.459737 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.459901 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.460079 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.460229 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.460352 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.460521 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.460648 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.460820 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.460945 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.461115 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.461240 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.461410 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.461534 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.461705 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.461829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.462023 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.462144 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.462308 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.462431 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.462608 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.462738 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.462911 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.463035 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.463214 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.463332 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.463519 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.463653 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.463817 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.463939 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.464142 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.464267 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.464442 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.464581 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.464737 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.464859 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.465043 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.465178 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.465344 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.465478 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.465641 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.465764 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.465936 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.466059 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.466237 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.466412 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.466550 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.466686 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.466849 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.466973 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.467149 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.467278 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.467462 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.467586 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.467776 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.467899 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.468113 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.468248 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.468410 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.468535 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.468710 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.468835 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.469009 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.469135 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.469308 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.469440 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.469605 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.469728 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.469904 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.470029 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.470206 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.470338 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.470505 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.470628 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.470805 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.470930 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.471106 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.471229 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.471404 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.471537 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.471699 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.471824 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.472012 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.472152 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.472315 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.472448 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.472610 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.472742 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.472923 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.473048 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.473223 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.473359 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.473518 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.473641 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.473814 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.473938 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.474117 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.474262 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.474439 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.474562 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.474733 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.474868 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.475043 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.475174 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.475348 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.475472 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.475654 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.475778 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.475959 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.476106 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.476293 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.476418 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.476599 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.476731 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.476902 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.477028 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.477200 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.477322 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.477495 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.477617 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.477809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.477932 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.478109 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.478234 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.478413 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.478547 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.478748 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.478885 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.479006 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.479126 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.479311 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.479445 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.479608 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.479730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.479921 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.480099 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.480249 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.480384 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.480549 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.480673 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.480844 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.480968 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.481153 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.481278 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.481446 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.481571 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.481757 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.481882 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.482097 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.482220 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.482445 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.482576 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.482742 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.482867 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.483099 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.483222 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.483410 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.483534 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.483712 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.483837 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.484025 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.484153 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.484340 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.484464 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.484654 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.484790 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.484950 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.485074 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.485249 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.485371 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.485545 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.485677 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.485859 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.485992 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.486156 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.486279 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.486459 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.486591 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.486766 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.486890 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.487064 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.487188 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.487379 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.487509 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.487693 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.487841 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.487996 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.488180 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.488327 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.488486 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.488730 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.488864 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.489045 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.489170 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.489351 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.489475 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.489659 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.489805 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.490045 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.490168 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.490341 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.490466 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.490638 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.490764 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.490939 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.491063 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.491236 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.491360 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.491533 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.491659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.491839 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.491963 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.492157 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.492280 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.492458 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.492585 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.492760 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.492887 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.493058 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.493191 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.493353 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.493478 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.493647 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.493771 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.493959 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.494098 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.494261 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.494385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.494576 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.494701 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.494880 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.495018 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.495193 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.495317 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.495504 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.495635 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.495801 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.495940 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.496139 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.496264 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.496442 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.496568 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.496736 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.496862 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.497034 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.497159 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.497330 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.497454 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.497633 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.497757 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.497934 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.498058 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.498235 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.498368 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.498555 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.498681 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.498856 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.498980 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.499159 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.499282 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.499471 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.499601 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.499784 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.499906 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.500121 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.500302 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.500426 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.500556 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.500729 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.500864 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.501027 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.501164 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.501322 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.501448 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.501619 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.501746 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.501912 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.502049 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.502206 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.502332 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.502501 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.502625 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.502799 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.502933 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.503093 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.503225 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.503384 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.503518 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.503676 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.503802 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.503990 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.504165 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.504314 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.504440 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.504631 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.504758 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.504931 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.505057 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.505224 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.505349 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.505541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.505668 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.505835 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.505968 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.506167 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.506295 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.506460 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.506587 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.506762 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.506878 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.507063 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.507267 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.507390 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.507513 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.507633 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.507753 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.507935 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.508090 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.508262 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.508387 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.508581 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.508707 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.508883 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.509017 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.509191 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.509314 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.509494 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.509617 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.509793 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.509931 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.510097 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.510222 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.510395 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.510526 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.510695 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.511169 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.511353 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.511478 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.511658 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.511783 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.511966 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.512155 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.512327 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.512491 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.512657 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.512815 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.512950 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.513124 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.513275 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.513427 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.513590 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.513714 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.513905 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.514031 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.514220 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.514354 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.514533 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.514735 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.514859 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.514981 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.515146 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.515280 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.515461 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.515595 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.515770 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.515895 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.516103 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.516228 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.516415 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.516551 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.516731 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.516856 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.517037 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.517242 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.517376 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.517566 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.517690 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.517878 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.518002 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.518189 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.518322 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.518499 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.518623 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.518808 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.518932 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.519119 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.519252 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.519423 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.519554 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.519727 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.519851 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.520050 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.520180 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.520353 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.520478 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.520657 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.520781 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.520963 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.521157 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.521345 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.521468 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.521644 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.521775 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.521950 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.522077 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.522253 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.522380 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.522568 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.522702 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.522878 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.523001 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.523191 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.523315 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.523498 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.523633 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.523805 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.523937 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.524142 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.524266 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.524447 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.524627 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.524751 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.524932 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.525057 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.525255 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.525389 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.525572 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.525698 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.525888 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.526012 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.526194 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.526332 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.526504 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.526629 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.526822 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.526956 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.527121 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.527255 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.527420 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.527545 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.527721 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.527852 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.528042 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.528171 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.528340 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.528464 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.528654 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.528778 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.528955 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.529094 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.529251 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.529485 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.529610 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.529799 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.529937 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.530130 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.530356 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.530481 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.530693 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.530827 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.531001 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.531126 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.531317 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.531440 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.531638 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.531772 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.531949 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.532088 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.532275 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.532410 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.532581 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.532714 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.532877 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.533015 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.533177 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.533309 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.533480 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.533612 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.533783 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.533909 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.534082 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.534205 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.534376 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.534501 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.534678 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.534802 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.534983 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.535206 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.535340 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.535546 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.535671 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.535855 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.535978 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.536202 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.536338 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.536508 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.536672 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.536832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.536958 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.537131 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.537265 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.537433 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.537565 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.537728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.537852 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.538024 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.538153 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.538320 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.538446 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.538616 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.538747 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.538917 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.539044 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.539212 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.539337 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.539512 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.539653 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.539810 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.539935 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.540133 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.540257 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.540430 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.540554 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.540730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.540855 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.541056 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.541181 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.541361 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.541494 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.541653 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.541780 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.541950 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.542067 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.542258 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.542395 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.542557 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.542679 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.542857 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.542984 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.543162 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.543366 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.543492 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.543611 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.543760 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.543892 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.544087 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.544226 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.544394 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.544616 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.544742 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.544948 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.545082 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.545266 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.545391 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.545571 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.545695 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.545902 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.546039 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.546205 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.546339 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.546504 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.546628 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.546803 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.546944 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.547116 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.547248 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.547416 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.547542 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.547719 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.547855 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.548038 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.548178 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.548344 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.548471 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.548643 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.548769 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.548944 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.549078 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.549243 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.549499 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.549635 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.549830 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.549953 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.550129 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.550254 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.550427 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.550562 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.550725 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.550850 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.551024 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.551190 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.551329 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.551451 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.551646 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.551772 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.551957 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.552101 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.552308 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.552456 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.552642 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.552774 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.552948 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.553072 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.553250 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.553374 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.553551 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.553676 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.553853 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.553983 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.554159 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.554277 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.554462 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.554585 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.554765 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.554902 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.555070 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.555194 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.555363 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.555486 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.555666 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.555799 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.555974 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.556150 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.556314 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.556439 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.556653 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.556789 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.556962 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.557085 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.557272 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.557389 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.557584 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.557708 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.557887 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.558021 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.558192 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.558323 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.558491 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.558622 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.558797 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.558920 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.559104 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.559229 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.559415 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.559547 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.559731 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.559861 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.560054 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.560194 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.560357 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.560483 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.560654 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.560780 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.560953 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.561088 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.561262 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.561395 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.561562 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.561697 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.561861 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.561997 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.562158 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.562275 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.562460 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.562585 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.562755 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.562881 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.563050 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.563176 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.563349 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.563477 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.563645 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.563778 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.563946 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.564138 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.564265 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.564413 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.564546 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.564735 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.564861 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.565038 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.565163 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.565338 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.565476 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.565640 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.565773 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.565943 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.566069 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.566249 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.566407 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.566530 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.566658 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.566824 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.566957 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.567119 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.567252 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.567412 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.567537 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.567710 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.567842 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.568051 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.568181 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.568358 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.568493 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.568662 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.568788 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.568969 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.569095 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.569268 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.569401 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.569569 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.569702 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.569868 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.569996 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.570166 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.570290 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.570467 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.570600 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.570767 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.570891 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.571075 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.571199 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.571374 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.571580 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.571714 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.571834 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.571954 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.572125 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.572256 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.572389 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.572561 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.572694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.572860 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.572984 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.573179 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.573306 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.573495 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.573630 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.573795 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.573920 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.574106 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.574230 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.574413 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.574540 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.574715 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.574841 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.575021 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.575154 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.575322 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.575447 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.575639 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.575776 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.575938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.576080 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.576262 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.576387 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.576570 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.576709 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.576873 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.577005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.577178 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.577304 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.577483 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.577608 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.577789 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.577913 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.578095 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.578218 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.578412 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.578537 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.578718 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.578851 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.579022 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.579153 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.579341 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.579472 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.579651 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.579782 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.579967 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.580136 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.580304 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.580430 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.580610 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.580735 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.580974 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.581110 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.581242 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.581364 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.581515 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.581648 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.581773 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 03:40:25.581908 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.582120 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.582429 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.582741 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.583053 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.583380 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.583752 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.584081 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.584410 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.584735 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.585077 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.585386 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.585729 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.586055 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.586368 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.586676 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.586979 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:40:25.587220 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 03:40:25.642253 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO dbcounter [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] Registered counter for database nova_api Jul 12 03:40:25.647534 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO dbcounter [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Registered counter for database nova_api Jul 12 03:40:25.761885 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG oslo_db.sqlalchemy.engines [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:40:25.763477 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_db.sqlalchemy.engines [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:40:25.768858 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG dbcounter [-] [109900] Writer thread running {{(pid=109900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:40:25.769763 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writer thread running {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:40:25.824484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.context [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05249ef8-00dc-42ee-b5c1-239ad6b1d9f7(cell1) {{(pid=109899) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 03:40:25.826757 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.context [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05249ef8-00dc-42ee-b5c1-239ad6b1d9f7(cell1) {{(pid=109900) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 03:40:25.828476 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:40:25.830054 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:40:25.830731 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG oslo_concurrency.lockutils [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:40:25.830868 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:40:25.832409 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG oslo_concurrency.lockutils [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:40:25.832942 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:40:25.833160 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG oslo_concurrency.lockutils [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:40:25.834986 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO dbcounter [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Registered counter for database nova_cell0 Jul 12 03:40:25.835317 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG oslo_concurrency.lockutils [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:40:25.837343 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO dbcounter [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] Registered counter for database nova_cell0 Jul 12 03:40:25.839138 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO dbcounter [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Registered counter for database nova_cell1 Jul 12 03:40:25.841183 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO dbcounter [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] Registered counter for database nova_cell1 Jul 12 03:40:25.848676 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_db.sqlalchemy.engines [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:40:25.850053 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_db.sqlalchemy.engines [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:40:25.852420 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG oslo_db.sqlalchemy.engines [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:40:25.854182 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG oslo_db.sqlalchemy.engines [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:40:25.856305 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writer thread running {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:40:25.858905 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writer thread running {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:40:25.860081 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG dbcounter [-] [109900] Writer thread running {{(pid=109900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:40:25.862079 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG dbcounter [-] [109900] Writer thread running {{(pid=109900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:40:26.001907 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO dbcounter [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Registered counter for database nova_cell0 Jul 12 03:40:26.002911 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO dbcounter [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] Registered counter for database nova_cell0 Jul 12 03:40:26.013801 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_db.sqlalchemy.engines [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:40:26.017565 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG oslo_db.sqlalchemy.engines [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:40:26.018178 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writer thread running {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:40:26.022321 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG dbcounter [-] [109900] Writer thread running {{(pid=109900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:40:26.353103 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: WARNING keystonemiddleware.auth_token [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 03:40:26.358164 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: WARNING keystonemiddleware.auth_token [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 03:40:26.360401 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: WARNING keystonemiddleware.auth_token [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 03:40:26.365633 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: WARNING keystonemiddleware.auth_token [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 03:40:26.702018 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: WARNING keystonemiddleware.auth_token [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 03:40:26.707833 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: WARNING keystonemiddleware.auth_token [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 03:40:26.707974 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: WARNING keystonemiddleware.auth_token [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 03:40:26.713311 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e51988c9c0 pid: 109899 (default app) Jul 12 03:40:26.714028 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: WARNING keystonemiddleware.auth_token [None req-d84c12be-7cdf-440a-8b6a-e96ebb0ab017 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 03:40:26.715412 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:40:26.716683 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001806 Jul 12 03:40:26.717084 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Jul 12 03:40:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:40:26.719220 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e51988c9c0 pid: 109900 (default app) Jul 12 03:41:43.090933 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:41:43.091936 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 12 03:41:43.092370 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:41:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:41:43.108586 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG dbcounter [-] [109900] Writing DB stats nova_api:SELECT=3 {{(pid=109900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:41:43.109559 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG dbcounter [-] [109900] Writing DB stats nova_cell1:SELECT=3 {{(pid=109900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:41:43.110646 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG dbcounter [-] [109900] Writing DB stats nova_cell0:SELECT=3 {{(pid=109900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:41:43.111466 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG dbcounter [-] [109900] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:41:44.027328 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-f26a5198-2ae7-4a1c-9778-b543c89df7d2 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:41:44.059656 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-f26a5198-2ae7-4a1c-9778-b543c89df7d2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.960488 Jul 12 03:41:44.066219 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 12 03:41:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:41:46.284277 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:41:46.285380 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-9d40a4d8-978d-4eae-885d-5c1d43343957 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jul 12 03:41:46.286169 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:41:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:41:46.765716 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-faf25174-a203-4c4e-8e2c-c9ea41084455 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "disk": 1, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:41:46.784745 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:41:46.784745 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: warnings.warn(msg) Jul 12 03:41:46.814539 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-faf25174-a203-4c4e-8e2c-c9ea41084455 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.522909 Jul 12 03:41:46.821026 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 03:41:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:41:46.829513 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writing DB stats nova_api:SELECT=3 {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:41:46.830503 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writing DB stats nova_cell0:SELECT=3 {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:41:46.831517 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writing DB stats nova_cell1:SELECT=3 {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:41:46.832298 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:41:47.036993 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-eaca3ea5-c940-4d24-b369-6eda8be4525f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:41:47.039451 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:41:47.039451 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: warnings.warn(msg) Jul 12 03:41:47.108518 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-eaca3ea5-c940-4d24-b369-6eda8be4525f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284792 Jul 12 03:41:47.112208 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 12 03:41:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:41:49.322946 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-faf25174-a203-4c4e-8e2c-c9ea41084455 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:41:49.324607 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-faf25174-a203-4c4e-8e2c-c9ea41084455 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002111 Jul 12 03:41:49.325010 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:41:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:41:49.977045 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-1df217e8-43a4-4ab9-b566-6005aac84905 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:41:49.995473 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:41:49.995473 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: warnings.warn(msg) Jul 12 03:41:50.015644 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-1df217e8-43a4-4ab9-b566-6005aac84905 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.684413 Jul 12 03:41:50.028636 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-ddcd5b9b-f413-4245-882f-c739565f0c7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:41:50.030408 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:41:50.030408 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: warnings.warn(msg) Jul 12 03:41:50.035553 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 03:41:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:41:50.068139 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-ddcd5b9b-f413-4245-882f-c739565f0c7e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043125 Jul 12 03:41:50.068735 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 12 03:41:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:41:52.268239 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-1df217e8-43a4-4ab9-b566-6005aac84905 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:41:52.269962 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-1df217e8-43a4-4ab9-b566-6005aac84905 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002245 Jul 12 03:41:52.272328 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:41:52.691014 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-7bda844f-674f-41e6-983e-3acf824beb31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "id": "d2", "swap": 0, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:41:52.708753 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-7bda844f-674f-41e6-983e-3acf824beb31 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432796 Jul 12 03:41:52.709589 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 03:41:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 03:41:52.721384 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-fb2437df-3e23-4cb7-ab0d-9952bd6ad7f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:41:52.746318 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-fb2437df-3e23-4cb7-ab0d-9952bd6ad7f8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028748 Jul 12 03:41:52.747011 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 12 03:41:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:41:54.995610 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-7bda844f-674f-41e6-983e-3acf824beb31 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:41:54.996774 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-7bda844f-674f-41e6-983e-3acf824beb31 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001719 Jul 12 03:41:54.997257 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:41:55.445377 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-a15c09dc-8cc9-4726-afaa-e124a1c326f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:41:55.468287 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-a15c09dc-8cc9-4726-afaa-e124a1c326f8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464273 Jul 12 03:41:55.476042 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 03:41:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:41:55.484141 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-2b1a33ba-4c44-42b8-a3fc-1c50de8cc03d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:41:55.512148 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-2b1a33ba-4c44-42b8-a3fc-1c50de8cc03d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033905 Jul 12 03:41:55.513044 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 12 03:41:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:41:57.725090 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-a15c09dc-8cc9-4726-afaa-e124a1c326f8 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:41:57.726120 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-a15c09dc-8cc9-4726-afaa-e124a1c326f8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 12 03:41:57.726944 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:41:58.152759 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-754cbeb7-a7d7-427b-ac63-00ad86b7e1a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:41:58.171939 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-754cbeb7-a7d7-427b-ac63-00ad86b7e1a4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439727 Jul 12 03:41:58.173320 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 03:41:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:41:58.185233 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-b9d111ed-267d-4525-942a-c02e62445f59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:41:58.214854 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-b9d111ed-267d-4525-942a-c02e62445f59 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033332 Jul 12 03:41:58.215813 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 12 03:41:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:42:00.450541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-754cbeb7-a7d7-427b-ac63-00ad86b7e1a4 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:00.451911 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-754cbeb7-a7d7-427b-ac63-00ad86b7e1a4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Jul 12 03:42:00.452494 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:00.894748 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-8c3b3ea4-fd50-4148-84f6-7caba6c55a25 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:00.920410 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-8c3b3ea4-fd50-4148-84f6-7caba6c55a25 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.461676 Jul 12 03:42:00.921027 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 12 03:42:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:42:03.247282 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-754cbeb7-a7d7-427b-ac63-00ad86b7e1a4 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:03.248795 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-754cbeb7-a7d7-427b-ac63-00ad86b7e1a4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 Jul 12 03:42:03.249322 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:03.662899 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-85641115-f023-43be-bb0f-449801991145 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "disk": 1}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:03.681566 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-85641115-f023-43be-bb0f-449801991145 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.425300 Jul 12 03:42:03.682404 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 03:42:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:42:03.694649 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-d8d69f12-ba53-489c-b555-ad66ba10b416 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:03.719045 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-d8d69f12-ba53-489c-b555-ad66ba10b416 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028206 Jul 12 03:42:03.719678 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 12 03:42:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:42:05.920719 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-85641115-f023-43be-bb0f-449801991145 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:05.921745 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-85641115-f023-43be-bb0f-449801991145 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jul 12 03:42:05.922165 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:06.445887 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-128ac166-4b1a-40fb-9bd0-7dcee623d4d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:06.464677 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-128ac166-4b1a-40fb-9bd0-7dcee623d4d6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.536702 Jul 12 03:42:06.465227 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 03:42:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:42:06.477071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-7868a6e7-4507-4c32-bf94-cf7b7415d5b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:06.501044 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-7868a6e7-4507-4c32-bf94-cf7b7415d5b3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027682 Jul 12 03:42:06.501751 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 12 03:42:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:42:08.676458 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-128ac166-4b1a-40fb-9bd0-7dcee623d4d6 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:08.677480 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-128ac166-4b1a-40fb-9bd0-7dcee623d4d6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 12 03:42:08.677916 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:42:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:09.085864 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-4da76476-a251-438c-9b9d-dafef5a19a72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:09.106048 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-4da76476-a251-438c-9b9d-dafef5a19a72 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.421622 Jul 12 03:42:09.106598 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 03:42:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:42:09.118404 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-680bbe7a-c559-4976-b1a5-fc8f4f5fc44d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:09.141513 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-680bbe7a-c559-4976-b1a5-fc8f4f5fc44d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026756 Jul 12 03:42:09.142226 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 12 03:42:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:42:11.428380 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-4da76476-a251-438c-9b9d-dafef5a19a72 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:11.429979 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-4da76476-a251-438c-9b9d-dafef5a19a72 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002799 Jul 12 03:42:11.430556 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:42:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:11.952331 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-a482a602-2b01-409e-a03b-cc7f4a725636 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "disk": 80}} {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:11.975996 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-a482a602-2b01-409e-a03b-cc7f4a725636 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.539332 Jul 12 03:42:11.976584 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 03:42:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 03:42:11.988669 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-4854851c-6641-4bad-8707-e630d1623f59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:12.012585 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-4854851c-6641-4bad-8707-e630d1623f59 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027631 Jul 12 03:42:12.013683 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 12 03:42:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:42:14.243893 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-a482a602-2b01-409e-a03b-cc7f4a725636 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:14.245550 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-a482a602-2b01-409e-a03b-cc7f4a725636 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002117 Jul 12 03:42:14.246113 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:42:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:14.687403 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-dae30319-6b47-4606-b3dd-f5af720ebf57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:14.705160 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-dae30319-6b47-4606-b3dd-f5af720ebf57 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.453190 Jul 12 03:42:14.705767 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 12 03:42:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:42:14.719877 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-a7a34c22-7181-4ba8-bdb0-3648a2dd6810 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:14.723901 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG dbcounter [-] [109900] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:42:14.746735 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-a7a34c22-7181-4ba8-bdb0-3648a2dd6810 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030431 Jul 12 03:42:14.760033 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 12 03:42:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:42:34.007909 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-dae30319-6b47-4606-b3dd-f5af720ebf57 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:34.009320 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-dae30319-6b47-4606-b3dd-f5af720ebf57 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001874 Jul 12 03:42:34.009714 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:34.488526 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-567c1f4d-9d4d-438f-a4fc-e47d4f9c83ae admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:34.513423 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-567c1f4d-9d4d-438f-a4fc-e47d4f9c83ae admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.497405 Jul 12 03:42:34.514229 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 12 03:42:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:42:35.606674 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-dae30319-6b47-4606-b3dd-f5af720ebf57 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:35.608267 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-dae30319-6b47-4606-b3dd-f5af720ebf57 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002316 Jul 12 03:42:35.608924 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 03:42:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:36.196749 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-7bfde7e3-a7f7-458b-b74e-5c92e5c6efd1 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:36.202896 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.wsgi [None req-7bfde7e3-a7f7-458b-b74e-5c92e5c6efd1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-7bfde7e3-a7f7-458b-b74e-5c92e5c6efd1 admin admin] Request method failure captured: Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Accept: application/json Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Accept-Encoding: gzip, deflate Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Connection: keep-alive Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Content-Length: 0 Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Host: 10.222.0.20 Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Openstack-Api-Version: compute 2.90 Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Openstack-System-Scope: None Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: User-Agent: python-novaclient Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Auth-Token: gAAAAABizO2rIQ96qVqd_U1B7083vOi-W7fNiN0G8dxJjgE0QNpSCkc0zbL-KQPi9Nvz9cKlz2J3wR1l2OAoQQg1LUhv7a8cIELzCiprVHA6AHtFYqqflSHlhjDQIUXUfsy3KJX9EpO7kB3v6T3iaTXVnVi8RD9sYzO_bReferP9rmEiL8UAZpU Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Domain-Id: None Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Domain-Name: None Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Identity-Status: Confirmed Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Is-Admin-Project: True Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Project-Domain-Id: default Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Project-Domain-Name: Default Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Project-Id: 579b7a08aae94d3fa59617c603862f30 Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Project-Name: admin Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Role: admin,member,reader Jul 12 03:42:36.206225 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Roles: admin,member,reader Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_579b7a08aae94d3fa59617c603862f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/579b7a08aae94d3fa59617c603862f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/579b7a08aae94d3fa59617c603862f30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/579b7a08aae94d3fa59617c603862f30"}]}] Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Tenant: admin Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Tenant-Id: 579b7a08aae94d3fa59617c603862f30 Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Tenant-Name: admin Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User: admin Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User-Domain-Id: default Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User-Domain-Name: Default Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User-Id: 819f4355d22549de99860edd3df36888 Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User-Name: admin Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: method: > Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: exception: Flavor 42 could not be found. Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: action_args: {'id': '42'} Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:42:36.207938 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:42:36.209143 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:36.210624 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-7bfde7e3-a7f7-458b-b74e-5c92e5c6efd1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:42:36.211892 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-7bfde7e3-a7f7-458b-b74e-5c92e5c6efd1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.454351 Jul 12 03:42:36.211892 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 12 03:42:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 456 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 03:42:36.219948 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-a31aa6f9-dcb6-41b9-9276-cb3e5c6e76bf admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:36.223692 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:42:36.243506 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-a31aa6f9-dcb6-41b9-9276-cb3e5c6e76bf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029242 Jul 12 03:42:36.244123 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 12 03:42:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:42:36.254484 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-da807913-84f6-45e2-a4a5-0db88d0645de admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:36.276420 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-da807913-84f6-45e2-a4a5-0db88d0645de admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025767 Jul 12 03:42:36.276962 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 12 03:42:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:42:36.286506 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-38fbb8f9-4c7a-423e-a31b-4293e9e43d4a admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:36.292781 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.wsgi [None req-38fbb8f9-4c7a-423e-a31b-4293e9e43d4a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-38fbb8f9-4c7a-423e-a31b-4293e9e43d4a admin admin] Request method failure captured: Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Accept: application/json Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Accept-Encoding: gzip, deflate Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Connection: keep-alive Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Content-Length: 0 Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Host: 10.222.0.20 Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Openstack-Api-Version: compute 2.90 Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Openstack-System-Scope: None Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: User-Agent: python-novaclient Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Auth-Token: gAAAAABizO2rIQ96qVqd_U1B7083vOi-W7fNiN0G8dxJjgE0QNpSCkc0zbL-KQPi9Nvz9cKlz2J3wR1l2OAoQQg1LUhv7a8cIELzCiprVHA6AHtFYqqflSHlhjDQIUXUfsy3KJX9EpO7kB3v6T3iaTXVnVi8RD9sYzO_bReferP9rmEiL8UAZpU Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Domain-Id: None Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Domain-Name: None Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Identity-Status: Confirmed Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Is-Admin-Project: True Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Project-Domain-Id: default Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Project-Domain-Name: Default Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Project-Id: 579b7a08aae94d3fa59617c603862f30 Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Project-Name: admin Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Role: admin,member,reader Jul 12 03:42:36.296071 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Roles: admin,member,reader Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_579b7a08aae94d3fa59617c603862f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/579b7a08aae94d3fa59617c603862f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/579b7a08aae94d3fa59617c603862f30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/579b7a08aae94d3fa59617c603862f30"}]}] Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Tenant: admin Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Tenant-Id: 579b7a08aae94d3fa59617c603862f30 Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Tenant-Name: admin Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User: admin Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User-Domain-Id: default Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User-Domain-Name: Default Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User-Id: 819f4355d22549de99860edd3df36888 Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User-Name: admin Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: method: > Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: exception: Flavor 42 could not be found. Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: action_args: {'id': '42'} Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:42:36.297659 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:42:36.298809 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:36.300162 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-38fbb8f9-4c7a-423e-a31b-4293e9e43d4a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:42:36.301398 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-38fbb8f9-4c7a-423e-a31b-4293e9e43d4a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014696 Jul 12 03:42:36.301601 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 12 03:42:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 03:42:37.310505 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-da807913-84f6-45e2-a4a5-0db88d0645de admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:37.311524 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-da807913-84f6-45e2-a4a5-0db88d0645de admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 12 03:42:37.311930 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 03:42:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:37.880056 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-307cc1f0-22ba-4395-bed2-4502eb85511c admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:37.885851 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.wsgi [None req-307cc1f0-22ba-4395-bed2-4502eb85511c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-307cc1f0-22ba-4395-bed2-4502eb85511c admin admin] Request method failure captured: Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Accept: application/json Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Accept-Encoding: gzip, deflate Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Connection: keep-alive Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Content-Length: 0 Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Host: 10.222.0.20 Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Openstack-Api-Version: compute 2.90 Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Openstack-System-Scope: None Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: User-Agent: python-novaclient Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Auth-Token: gAAAAABizO2tPthi-sG-Axl3TXfmWFojn4N3vPMAN6AMc7aNlZnMVmouDtSK4eUgzlk8-I2ZY3kS_av0gTmGhGSTxpCuaObj-6HRtBFd9zsNj9xhC8prwCcYgkD_UCKx6vkoNabRZFPBFEaL-rBi-XaNdzCjF0TRZBb8R_P9RUJli9cw28i4Jco Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Domain-Id: None Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Domain-Name: None Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Identity-Status: Confirmed Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Is-Admin-Project: True Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Project-Domain-Id: default Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Project-Domain-Name: Default Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Project-Id: 579b7a08aae94d3fa59617c603862f30 Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Project-Name: admin Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Role: admin,member,reader Jul 12 03:42:37.887385 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Roles: admin,member,reader Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_579b7a08aae94d3fa59617c603862f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/579b7a08aae94d3fa59617c603862f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/579b7a08aae94d3fa59617c603862f30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/579b7a08aae94d3fa59617c603862f30"}]}] Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Tenant: admin Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Tenant-Id: 579b7a08aae94d3fa59617c603862f30 Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Tenant-Name: admin Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User: admin Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User-Domain-Id: default Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User-Domain-Name: Default Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User-Id: 819f4355d22549de99860edd3df36888 Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User-Name: admin Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: method: > Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: exception: Flavor 84 could not be found. Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: action_args: {'id': '84'} Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:42:37.889005 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:42:37.889829 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:37.890971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-307cc1f0-22ba-4395-bed2-4502eb85511c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:42:37.891981 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-307cc1f0-22ba-4395-bed2-4502eb85511c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.440055 Jul 12 03:42:37.891981 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 12 03:42:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 03:42:37.898774 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-df5076b7-8b5c-44b7-b6d0-03d025380e3b admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:37.912517 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-df5076b7-8b5c-44b7-b6d0-03d025380e3b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017205 Jul 12 03:42:37.913033 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 12 03:42:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:42:37.922370 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-e7774099-49b7-450e-bc77-8272b80423d0 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:37.940233 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-e7774099-49b7-450e-bc77-8272b80423d0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021240 Jul 12 03:42:37.940780 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 12 03:42:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:42:37.950962 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-91dc8189-2d9f-40ea-8f14-8256c410bc7a admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:37.956826 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.wsgi [None req-91dc8189-2d9f-40ea-8f14-8256c410bc7a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-91dc8189-2d9f-40ea-8f14-8256c410bc7a admin admin] Request method failure captured: Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Accept: application/json Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Accept-Encoding: gzip, deflate Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Connection: keep-alive Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Content-Length: 0 Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Host: 10.222.0.20 Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Openstack-Api-Version: compute 2.90 Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Openstack-System-Scope: None Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: User-Agent: python-novaclient Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Auth-Token: gAAAAABizO2tPthi-sG-Axl3TXfmWFojn4N3vPMAN6AMc7aNlZnMVmouDtSK4eUgzlk8-I2ZY3kS_av0gTmGhGSTxpCuaObj-6HRtBFd9zsNj9xhC8prwCcYgkD_UCKx6vkoNabRZFPBFEaL-rBi-XaNdzCjF0TRZBb8R_P9RUJli9cw28i4Jco Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Domain-Id: None Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Domain-Name: None Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Identity-Status: Confirmed Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Is-Admin-Project: True Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Project-Domain-Id: default Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Project-Domain-Name: Default Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Project-Id: 579b7a08aae94d3fa59617c603862f30 Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Project-Name: admin Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Role: admin,member,reader Jul 12 03:42:37.958352 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Roles: admin,member,reader Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_579b7a08aae94d3fa59617c603862f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/579b7a08aae94d3fa59617c603862f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/579b7a08aae94d3fa59617c603862f30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/579b7a08aae94d3fa59617c603862f30"}]}] Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Tenant: admin Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Tenant-Id: 579b7a08aae94d3fa59617c603862f30 Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Tenant-Name: admin Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User: admin Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User-Domain-Id: default Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User-Domain-Name: Default Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User-Id: 819f4355d22549de99860edd3df36888 Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User-Name: admin Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: method: > Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: exception: Flavor 84 could not be found. Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: action_args: {'id': '84'} Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:42:37.959808 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:42:37.960694 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:37.961728 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-91dc8189-2d9f-40ea-8f14-8256c410bc7a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:42:37.962722 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-91dc8189-2d9f-40ea-8f14-8256c410bc7a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012414 Jul 12 03:42:37.962722 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 12 03:42:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 03:42:38.957501 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-e7774099-49b7-450e-bc77-8272b80423d0 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:38.958523 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-e7774099-49b7-450e-bc77-8272b80423d0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 12 03:42:38.958918 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 03:42:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:39.536596 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-b283114a-c29b-4fb8-aef3-db438b1432d3 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:39.545113 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.wsgi [None req-b283114a-c29b-4fb8-aef3-db438b1432d3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-b283114a-c29b-4fb8-aef3-db438b1432d3 admin admin] Request method failure captured: Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Accept: application/json Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Accept-Encoding: gzip, deflate Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Connection: keep-alive Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Content-Length: 0 Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Host: 10.222.0.20 Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Openstack-Api-Version: compute 2.90 Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Openstack-System-Scope: None Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: User-Agent: python-novaclient Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Auth-Token: gAAAAABizO2uYp_wwifCPe7rhROs5GNNU7PBVXfcnDhUxXxRGv9oA6cLLOQZU3xxTva-Z-2jgEELZyGu_zFHOdt7bxnWgkE8nUpsmYhLD56E4Vvork4s0y9P03_GabJuXh_MZoZFTtUveKwQO53d_GRqWDsPEa439WDM_Sp1biTUGbmgWluwE78 Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Domain-Id: None Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Domain-Name: None Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Identity-Status: Confirmed Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Is-Admin-Project: True Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Project-Domain-Id: default Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Project-Domain-Name: Default Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Project-Id: 579b7a08aae94d3fa59617c603862f30 Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Project-Name: admin Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Role: admin,member,reader Jul 12 03:42:39.547080 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Roles: admin,member,reader Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_579b7a08aae94d3fa59617c603862f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/579b7a08aae94d3fa59617c603862f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/579b7a08aae94d3fa59617c603862f30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/579b7a08aae94d3fa59617c603862f30"}]}] Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Tenant: admin Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Tenant-Id: 579b7a08aae94d3fa59617c603862f30 Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-Tenant-Name: admin Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User: admin Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User-Domain-Id: default Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User-Domain-Name: Default Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User-Id: 819f4355d22549de99860edd3df36888 Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: X-User-Name: admin Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: method: > Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: exception: Flavor 451 could not be found. Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: action_args: {'id': '451'} Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:42:39.548620 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:42:39.549541 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: ERROR nova.api.openstack.wsgi Jul 12 03:42:39.550832 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-b283114a-c29b-4fb8-aef3-db438b1432d3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:42:39.551878 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-b283114a-c29b-4fb8-aef3-db438b1432d3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.451264 Jul 12 03:42:39.551878 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 12 03:42:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 03:42:39.558366 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-a00ba1e1-ed2b-45a7-9334-20b7efc6f08a admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:39.572493 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-a00ba1e1-ed2b-45a7-9334-20b7efc6f08a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017745 Jul 12 03:42:39.573023 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 12 03:42:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:42:39.582714 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:39.597957 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018791 Jul 12 03:42:39.598525 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 12 03:42:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:42:39.607837 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-291991d3-78e6-4f9f-b5d5-7007e30cee77 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:39.613609 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.wsgi [None req-291991d3-78e6-4f9f-b5d5-7007e30cee77 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-291991d3-78e6-4f9f-b5d5-7007e30cee77 admin admin] Request method failure captured: Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Accept: application/json Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Accept-Encoding: gzip, deflate Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Connection: keep-alive Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Content-Length: 0 Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Host: 10.222.0.20 Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Openstack-Api-Version: compute 2.90 Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Openstack-System-Scope: None Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: User-Agent: python-novaclient Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Auth-Token: gAAAAABizO2uYp_wwifCPe7rhROs5GNNU7PBVXfcnDhUxXxRGv9oA6cLLOQZU3xxTva-Z-2jgEELZyGu_zFHOdt7bxnWgkE8nUpsmYhLD56E4Vvork4s0y9P03_GabJuXh_MZoZFTtUveKwQO53d_GRqWDsPEa439WDM_Sp1biTUGbmgWluwE78 Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Domain-Id: None Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Domain-Name: None Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Identity-Status: Confirmed Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Is-Admin-Project: True Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Project-Domain-Id: default Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Project-Domain-Name: Default Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Project-Id: 579b7a08aae94d3fa59617c603862f30 Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Project-Name: admin Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Role: admin,member,reader Jul 12 03:42:39.615128 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Roles: admin,member,reader Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_579b7a08aae94d3fa59617c603862f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/579b7a08aae94d3fa59617c603862f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/579b7a08aae94d3fa59617c603862f30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/579b7a08aae94d3fa59617c603862f30"}]}] Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Tenant: admin Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Tenant-Id: 579b7a08aae94d3fa59617c603862f30 Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-Tenant-Name: admin Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User: admin Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User-Domain-Id: default Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User-Domain-Name: Default Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User-Id: 819f4355d22549de99860edd3df36888 Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: X-User-Name: admin Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: method: > Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: exception: Flavor 451 could not be found. Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: action_args: {'id': '451'} Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:42:39.616567 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:42:39.617484 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: ERROR nova.api.openstack.wsgi Jul 12 03:42:39.618730 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-291991d3-78e6-4f9f-b5d5-7007e30cee77 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109899) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:42:39.620057 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-291991d3-78e6-4f9f-b5d5-7007e30cee77 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012232 Jul 12 03:42:39.620057 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 12 03:42:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 03:42:40.578771 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:40.580153 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001923 Jul 12 03:42:40.580539 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 03:42:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:41.164412 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-601cead8-cab7-466d-9981-b784d6ebd87c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:41.185020 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-601cead8-cab7-466d-9981-b784d6ebd87c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.461599 Jul 12 03:42:41.185589 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 12 03:42:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:42:42.158858 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:42.160043 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Jul 12 03:42:42.160456 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 03:42:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:42.748268 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-c2be8c40-cdab-4293-8285-b40efbb2f004 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:42.771501 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-c2be8c40-cdab-4293-8285-b40efbb2f004 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.474824 Jul 12 03:42:42.772062 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 12 03:42:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:42:43.761594 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:43.762611 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 12 03:42:43.763002 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 03:42:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 03:42:44.317886 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-34fa5022-599d-4fe4-9eb1-0c76d69fafbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:44.337538 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-34fa5022-599d-4fe4-9eb1-0c76d69fafbe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.438453 Jul 12 03:42:44.338078 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 12 03:42:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:42:45.325872 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:45.326882 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 12 03:42:45.327247 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 03:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:45.926897 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-16f29542-b89d-41f4-bd4d-48ee5f5f11fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:42:45.947134 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-16f29542-b89d-41f4-bd4d-48ee5f5f11fa admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.483297 Jul 12 03:42:45.947678 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 12 03:42:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:42:46.926588 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:46.927597 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 12 03:42:46.928031 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 03:42:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:42:47.474498 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-4fc4d420-ea7c-4e40-8a33-12ab7a01e184 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:42:47.499419 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-4fc4d420-ea7c-4e40-8a33-12ab7a01e184 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.436546 Jul 12 03:42:47.499971 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Jul 12 03:42:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:43:40.165991 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:43:40.167018 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-a2349cbd-e26a-4357-add4-9757bd5de096 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 12 03:43:40.167410 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 12 03:43:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:43:40.180397 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:43:40.599255 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-bf829700-12aa-4637-ab8e-a766319d9e1e admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:43:40.618299 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-bf829700-12aa-4637-ab8e-a766319d9e1e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.444644 Jul 12 03:43:40.618850 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 12 03:43:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:43:40.641229 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG dbcounter [-] [109900] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=109900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:43:40.646029 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-dc87487c-9fad-4c8a-a368-99c6a5edb2a1 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:43:40.657635 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-dc87487c-9fad-4c8a-a368-99c6a5edb2a1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018509 Jul 12 03:43:40.658397 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Tue Jul 12 03:43:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:43:40.671416 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-85b9a659-f8da-4740-aca8-836f49e97b80 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:43:40.679373 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-85b9a659-f8da-4740-aca8-836f49e97b80 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011780 Jul 12 03:43:40.679948 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Jul 12 03:43:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:43:40.692385 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-3cc0b492-9a8f-469f-8591-c99fad680e48 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:43:40.701470 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-3cc0b492-9a8f-469f-8591-c99fad680e48 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013149 Jul 12 03:43:40.701964 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Jul 12 03:43:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:43:40.717479 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-7f488c2f-cf23-4ca7-a03f-eeaa9fb3a0c4 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:43:40.725423 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-7f488c2f-cf23-4ca7-a03f-eeaa9fb3a0c4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012331 Jul 12 03:43:40.726085 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Tue Jul 12 03:43:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:47:06.753668 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-3cc0b492-9a8f-469f-8591-c99fad680e48 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:47:06.754691 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-3cc0b492-9a8f-469f-8591-c99fad680e48 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 12 03:47:06.755085 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 03:47:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:47:06.894915 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writing DB stats nova_api:SELECT=6 {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:47:07.070767 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-00bf6996-0e37-4c14-b89d-9b7ad5b8c114 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:47:07.071943 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:47:07.071943 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: warnings.warn(msg) Jul 12 03:47:07.073192 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-00bf6996-0e37-4c14-b89d-9b7ad5b8c114 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:47:07.073624 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-00bf6996-0e37-4c14-b89d-9b7ad5b8c114 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:47:07.074418 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-00bf6996-0e37-4c14-b89d-9b7ad5b8c114 admin admin] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:47:07.074841 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-00bf6996-0e37-4c14-b89d-9b7ad5b8c114 admin admin] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:47:07.110356 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-00bf6996-0e37-4c14-b89d-9b7ad5b8c114 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.216589 Jul 12 03:47:07.111105 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 12 03:47:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:47:07.933698 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-3cc0b492-9a8f-469f-8591-c99fad680e48 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:47:07.934720 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-3cc0b492-9a8f-469f-8591-c99fad680e48 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 12 03:47:07.935119 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 03:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:47:08.141818 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-1e991215-a3e8-4c16-9b4b-2bb3b585dec7 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:47:08.142938 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:47:08.142938 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: warnings.warn(msg) Jul 12 03:47:08.144155 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-1e991215-a3e8-4c16-9b4b-2bb3b585dec7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:47:08.144589 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-1e991215-a3e8-4c16-9b4b-2bb3b585dec7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:47:08.145414 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-1e991215-a3e8-4c16-9b4b-2bb3b585dec7 admin admin] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:47:08.145811 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-1e991215-a3e8-4c16-9b4b-2bb3b585dec7 admin admin] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:47:08.165917 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-1e991215-a3e8-4c16-9b4b-2bb3b585dec7 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.088295 Jul 12 03:47:08.166460 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 12 03:47:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:47:19.422963 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-3cc0b492-9a8f-469f-8591-c99fad680e48 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:47:19.424015 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-3cc0b492-9a8f-469f-8591-c99fad680e48 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 12 03:47:19.424414 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 03:47:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:47:19.567888 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writing DB stats nova_cell0:SELECT=4 {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:47:19.568631 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writing DB stats nova_cell1:SELECT=4 {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:47:19.569278 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG dbcounter [-] [109899] Writing DB stats nova_api:SELECT=8 {{(pid=109899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:47:19.620457 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-4237efbc-8ee5-4d8a-9211-cbff9c058f91 admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:47:19.621623 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:47:19.621623 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: warnings.warn(msg) Jul 12 03:47:19.622789 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-4237efbc-8ee5-4d8a-9211-cbff9c058f91 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:47:19.623221 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-4237efbc-8ee5-4d8a-9211-cbff9c058f91 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:47:19.623984 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-4237efbc-8ee5-4d8a-9211-cbff9c058f91 admin admin] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:47:19.624486 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-4237efbc-8ee5-4d8a-9211-cbff9c058f91 admin admin] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:47:19.649428 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-4237efbc-8ee5-4d8a-9211-cbff9c058f91 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087934 Jul 12 03:47:19.650343 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 12 03:47:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:47:20.484511 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: DEBUG nova.api.openstack.wsgi [None req-3cc0b492-9a8f-469f-8591-c99fad680e48 admin admin] Calling method '>' {{(pid=109900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:47:20.485526 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: INFO nova.api.openstack.requestlog [None req-3cc0b492-9a8f-469f-8591-c99fad680e48 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 12 03:47:20.485914 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: [pid: 109900|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 12 03:47:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:47:20.701780 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG nova.api.openstack.wsgi [None req-ca07f70d-4910-4373-b939-15762b100d4e admin admin] Calling method '>' {{(pid=109899) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:47:20.703420 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 03:47:20.703420 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: warnings.warn(msg) Jul 12 03:47:20.705678 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-ca07f70d-4910-4373-b939-15762b100d4e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:47:20.706295 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-ca07f70d-4910-4373-b939-15762b100d4e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:47:20.707414 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-ca07f70d-4910-4373-b939-15762b100d4e admin admin] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:47:20.707817 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: DEBUG oslo_concurrency.lockutils [None req-ca07f70d-4910-4373-b939-15762b100d4e admin admin] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109899) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:47:20.730285 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: INFO nova.api.openstack.requestlog [None req-ca07f70d-4910-4373-b939-15762b100d4e admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.097465 Jul 12 03:47:20.730860 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: [pid: 109899|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 12 03:47:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:48:16.642954 dv-cinder-847730-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 03:48:16.643695 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: Tue Jul 12 03:48:16 2022 - graceful shutdown triggered... Jul 12 03:48:16.644207 dv-cinder-847730-4-iscsi devstack@n-api.service[109899]: Gracefully killing worker 1 (pid: 109899)... Jul 12 03:48:16.644568 dv-cinder-847730-4-iscsi devstack@n-api.service[109900]: Gracefully killing worker 2 (pid: 109900)... Jul 12 03:48:17.644946 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: worker 1 buried after 1 seconds Jul 12 03:48:17.644946 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: worker 2 buried after 1 seconds Jul 12 03:48:17.644946 dv-cinder-847730-4-iscsi devstack@n-api.service[109898]: goodbye to uWSGI. Jul 12 03:48:17.647468 dv-cinder-847730-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 03:48:17.648432 dv-cinder-847730-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 03:48:17.653288 dv-cinder-847730-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 03:48:17.670615 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 03:48:17.672714 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 03:48:17 2022] *** Jul 12 03:48:17.672714 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 03:48:17.672714 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 03:48:17.672714 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: nodename: dv-cinder-847730-4-iscsi Jul 12 03:48:17.672714 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: machine: x86_64 Jul 12 03:48:17.672714 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: clock source: unix Jul 12 03:48:17.672714 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: pcre jit disabled Jul 12 03:48:17.672714 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: detected number of CPU cores: 4 Jul 12 03:48:17.672714 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: current working directory: / Jul 12 03:48:17.672714 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: detected binary path: /usr/bin/uwsgi-core Jul 12 03:48:17.673359 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: your processes number limit is 47680 Jul 12 03:48:17.673359 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: your memory page size is 4096 bytes Jul 12 03:48:17.673359 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: detected max file descriptor number: 2048 Jul 12 03:48:17.673359 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: lock engine: pthread robust mutexes Jul 12 03:48:17.673359 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: thunder lock: enabled Jul 12 03:48:17.673359 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 03:48:17.673716 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 03:48:17.725191 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: Python main interpreter initialized at 0x55cc90dd69c0 Jul 12 03:48:17.725191 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: python threads support enabled Jul 12 03:48:17.725191 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: your server socket listen backlog is limited to 100 connections Jul 12 03:48:17.725191 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: your mercy for graceful operations on workers is 90 seconds Jul 12 03:48:17.725709 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 03:48:17.725928 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: *** Operational MODE: preforking *** Jul 12 03:48:17.726427 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: *** uWSGI is running in multiple interpreter mode *** Jul 12 03:48:17.726427 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: spawned uWSGI master process (pid: 124411) Jul 12 03:48:17.726616 dv-cinder-847730-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 03:48:17.727364 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: spawned uWSGI worker 1 (pid: 124434, cores: 1) Jul 12 03:48:17.728061 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: spawned uWSGI worker 2 (pid: 124435, cores: 1) Jul 12 03:48:17.728401 dv-cinder-847730-4-iscsi devstack@n-api.service[124411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 03:48:18.380771 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 03:48:18.381442 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 03:48:19.568873 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 03:48:19.568873 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: from cryptography.utils import int_from_bytes Jul 12 03:48:19.569556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 03:48:19.569556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: from cryptography.utils import int_from_bytes Jul 12 03:48:19.571873 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 03:48:19.571873 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: from cryptography.utils import int_from_bytes Jul 12 03:48:19.572438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 03:48:19.572438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: from cryptography.utils import int_from_bytes Jul 12 03:48:21.856513 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 03:48:21.857175 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 03:48:21.857270 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 03:48:21.857626 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 03:48:21.857884 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 03:48:21.858279 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.858608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.858965 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.859259 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.859595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.859937 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.860285 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.860606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.860934 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.861169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.861568 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.861802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847730-4-iscsi {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.862157 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.862464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.862771 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.863093 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.863409 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.863688 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.864042 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.864532 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.865914 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.865914 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.865914 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.866193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.866519 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.866826 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.867136 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.867461 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.867795 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.868119 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.868567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847730-4-iscsi {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.868871 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.869163 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.869479 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.869927 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.870284 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.870570 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.870894 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.871229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.871547 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.871877 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.872227 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.872543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.872872 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.873176 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.873486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.873796 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.874120 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.874411 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.874734 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.874985 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.875292 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.875449 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 03:48:21.875913 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.876104 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 03:48:21.876272 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.876415 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 03:48:21.876603 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.876603 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.876958 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 03:48:21.877109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.877265 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 03:48:21.877405 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.877546 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.877697 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.877846 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.878004 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.878155 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.878306 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.878452 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.878636 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.878802 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.878978 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.879133 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.879281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.879430 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.879572 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.879719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.880146 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.880305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.880454 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.880867 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.881028 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.881180 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.881368 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.881519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847730-4-iscsi {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.881742 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.881888 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.882037 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.882267 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.882418 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.882565 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.882713 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.882860 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.883013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.883171 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.883322 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.883473 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.883625 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.883773 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.883925 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.883925 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.884318 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.884495 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.884639 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.884781 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.884935 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.885082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.885243 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.885390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.885540 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.886315 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.886486 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.886637 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.886786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.886933 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.887092 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.887235 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.887384 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.887533 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.887693 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.887843 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.887994 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.888177 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.888328 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847730-4-iscsi {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.888469 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.888608 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.888748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.888901 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.889043 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.889190 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.889338 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.889338 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.889632 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.889782 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.889948 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.890287 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.890670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.891103 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.891253 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.891435 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.892294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.892462 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.892614 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.892756 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.892895 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.893065 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.893208 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.893356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.893513 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.893654 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.893805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.893954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.894105 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.894257 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.894490 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.894637 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.894791 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.894949 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.895100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.895252 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.895398 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.895555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.895704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.895857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.896016 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.896181 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.896329 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.896477 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.896625 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.896772 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.896923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.897077 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.897226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.897377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.897518 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.897666 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.897816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.897968 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.898108 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.898263 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.898415 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.898564 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.898736 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.898889 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.899040 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.899180 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.899328 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.899483 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.899634 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.899781 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.899928 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.900380 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.900545 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.900697 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.900848 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.901384 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.901541 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.902037 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.902185 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.902362 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.902643 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.902798 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.902947 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.903098 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.903245 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.903399 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.903540 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.903691 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.903691 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.903974 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.903974 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.904278 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.904439 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.904661 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.904661 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.904939 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.905094 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.905236 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.905236 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.905512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.905676 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.905827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.905985 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.906126 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.906265 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.906412 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.906559 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.906707 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.906861 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.907002 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.907141 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.907281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.907438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.907596 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.907745 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.907885 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.908067 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.908216 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.908356 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.908509 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.908650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.908789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.908934 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.909087 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.909239 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.909409 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.909559 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.909699 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.909846 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.909994 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.910142 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.910311 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.910660 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.910814 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.910961 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.911309 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.911596 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.911596 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.911898 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.912081 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.912228 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.912376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.912587 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.912817 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.912963 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.913102 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.913251 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.913393 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.913622 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.913773 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.913921 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.914079 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.914225 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.914365 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.914529 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.916419 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.916598 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.916752 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.916912 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.917066 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.917216 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.917363 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.917514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.917712 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.917854 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.917993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.918134 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.918282 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.918433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.918581 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.918724 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.918864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.919020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.919162 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.919312 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.919453 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.919611 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.919754 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.919894 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.920064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.920227 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.920375 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.920375 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.920880 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.920880 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.921552 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.921552 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.921959 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.922116 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.922278 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.922419 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.922569 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.922717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.922973 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.923120 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.923304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.923456 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.923598 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.923737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.923891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.924066 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.924220 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.924386 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.924540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.924695 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.924844 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.924998 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.925147 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.925287 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.925426 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.925582 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.925731 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.925871 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.926020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.926160 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 03:48:21.926310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.926542 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.926700 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.926848 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.926989 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.926989 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.927271 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.927422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.927569 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.927723 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.927865 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.928033 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.928206 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.928356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.928496 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.928636 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.928776 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.928923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.929078 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.929228 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.929376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.929524 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.929672 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.929812 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.929969 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.930121 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.931055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.931219 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.931575 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.931739 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.931983 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.932219 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.932371 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.932607 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.932759 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.932916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.933167 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.933333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.934057 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.934217 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.934502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.934676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.934836 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.934977 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.935118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.935257 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.935398 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.935552 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.935694 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.935834 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.935996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.936168 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.936330 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.936480 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.936713 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.936857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.937007 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.937154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.937309 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.937449 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.937449 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.937723 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.937863 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.938038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.945155 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.945360 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.945523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.945673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.945828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.945984 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.946139 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.946283 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.946425 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.946575 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.946736 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.946974 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.947136 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.947277 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.947426 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.947575 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.947723 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.947878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.948219 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.948383 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.948534 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.951123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.951288 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.951451 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.951621 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.951766 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.951916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.952076 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.952225 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.952416 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.952696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.952846 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.952996 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.953145 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.953371 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.953515 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.953655 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.953807 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.953955 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.954104 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.954478 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.954642 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.954791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.955032 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.955345 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.955504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.955658 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.955800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.955949 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.961743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.962374 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.962480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.962570 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.962694 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.962782 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.962864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.962955 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.963052 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.963145 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.963228 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.963317 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.963407 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.963498 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.963582 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.963696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.963788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.963885 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.963976 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.964097 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.964191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.964276 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.964378 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.964489 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.964581 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.964676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.964760 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.964843 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.964930 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.965526 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.965623 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.965721 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.965823 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.965916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.965999 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.966088 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.966183 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.966274 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.966356 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.966437 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.966518 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.966599 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.966688 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.966772 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.966854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.966936 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.967024 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.967113 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.967203 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.967293 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.967375 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.967455 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.967543 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.967636 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.967731 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.967822 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.967911 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.967993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.968134 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.968228 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.968312 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.968394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.968485 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.968569 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.968658 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.968754 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.968844 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.968934 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.969023 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.969113 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.969195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.969291 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.969380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.969472 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.969562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.969652 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.969742 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.969840 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.969925 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.970263 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.970364 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.970364 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.970537 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.970537 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.970696 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.970779 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.970870 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.970870 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.971043 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.971126 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.971215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.971298 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.971386 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.971386 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.971552 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.971648 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.971748 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.971836 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.971926 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.972032 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.972131 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.972223 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.972313 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.972396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.972476 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.972560 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.972649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.972733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.972814 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.972896 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.972977 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.973071 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.973155 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.973242 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.973325 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.973416 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.973498 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.973588 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.973671 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.973752 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.973849 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.973934 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.974015 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.974104 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.974188 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.974280 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.974363 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.974444 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.974530 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.974614 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.974697 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.974778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.974858 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.974946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.975038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.975432 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.975701 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.975804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.975889 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.975979 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.976093 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.976178 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.976267 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.976349 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.976437 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.976520 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.976613 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.976697 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.976778 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.976858 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.976946 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977036 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977127 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977209 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977300 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977473 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977568 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977651 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977740 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977822 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977910 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977992 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977992 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.977992 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.978223 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.978304 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.978304 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.978304 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.978304 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.978304 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.978733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.978816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.978816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.978816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.978816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.979119 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.979200 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.979200 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.979477 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.979572 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.979572 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.979572 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.979572 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.979572 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.979926 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.980070 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.980070 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.980070 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.980070 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.980070 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.981152 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.981252 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.981252 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.981252 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.981252 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.981572 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.981662 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.981662 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.981662 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.981662 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.981662 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982052 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982147 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982147 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982147 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982147 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982147 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982147 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982147 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982653 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982741 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982741 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982741 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982741 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.982741 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.983152 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.983243 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.983243 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.983413 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.983498 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.983498 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.983498 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.983498 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.983498 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.983498 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.983943 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.984045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.984045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.984045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.984045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.984045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.984045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.984490 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.984591 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.984591 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.984757 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.984848 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.984930 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.985018 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.985018 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.985018 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.985018 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.985018 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.985916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986010 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986010 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986010 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986010 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986010 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986010 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986010 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986643 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986643 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986643 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986643 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.986952 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.987041 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.987041 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.987041 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.987041 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.987361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.987450 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.987539 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.987696 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.988026 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.988132 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.988359 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.988654 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.988761 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.988969 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.989245 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.989342 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.989572 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.989845 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.989938 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.990212 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.990432 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.990560 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.990878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.990994 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.991227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.991501 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.991590 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.991834 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.992122 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.992234 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.992494 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.992714 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.992812 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.993934 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.994058 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.994155 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.994240 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.994323 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.994404 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.994496 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.994496 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.994665 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.994880 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.995364 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.995758 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.995871 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.996296 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.996296 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.996470 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.996556 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.996882 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.997084 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.997183 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.997494 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.997704 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.997794 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.998109 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.998367 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.998459 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.998720 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.998948 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.999051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.999331 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.999563 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.999654 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:21.999957 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.000155 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.000291 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.000604 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.000715 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.000919 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.001221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.001311 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.001535 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.001815 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.001913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.002168 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.002402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.002492 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.002774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.002975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.003077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.003383 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.003561 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.003694 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.004055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.004150 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.004527 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.004617 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.004852 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.005140 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.005232 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.005524 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.005881 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.005987 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.006094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.006423 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.006538 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.006675 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.006872 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.006971 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.007280 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.007467 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.007593 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.007904 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.008081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.008247 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.008580 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.008683 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.008899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.009162 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.009260 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.009509 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.009763 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.009866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.010162 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.010346 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.010494 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.010894 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.011008 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.011206 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.011876 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.011985 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.011985 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.012203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.012306 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.012493 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.012696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.012796 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.013089 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.013271 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.013642 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.013735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.013838 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.014056 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.014322 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.014414 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.014785 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.014889 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.015113 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.015396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.015495 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.015748 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.015748 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.016291 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.016399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.016722 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.016892 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.017033 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.017351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.017478 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.017672 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.017982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.018074 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.018295 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.018558 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.018657 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.018914 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.019143 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.019243 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.019536 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.019757 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.019856 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.020184 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.020449 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.020540 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.020808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.021053 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.021164 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.021403 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.021655 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.021746 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.022036 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.022239 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.022331 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.022646 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.022825 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.022956 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.023301 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.023409 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.023581 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.023891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.024064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.024376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.024465 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.024805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.024963 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.025063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.025293 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.025559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.025673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.026289 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.026398 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.026483 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.027088 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.027231 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.027395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.027496 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.027717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.027927 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.028060 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.028383 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.028486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.028699 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.028908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.029009 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.029312 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.029402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.029641 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.029856 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.029956 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.030250 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.030340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.030559 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.030783 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.030899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.031183 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.031317 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.031510 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.031763 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.031936 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.032280 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.032374 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.032587 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.032782 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.033009 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.033236 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.033335 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.033625 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.033743 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.033954 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.034195 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.034287 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.034598 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.034686 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.034910 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.035129 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.035229 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.035528 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.035617 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.035858 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.036078 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.036231 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.036527 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.036630 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.036859 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.037031 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.037160 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.037470 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.037581 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.037797 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.037959 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.038114 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.038419 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.038524 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.038848 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.038938 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.039176 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.039356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.039488 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.039814 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.039913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.040179 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.040344 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.040491 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.040800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.040890 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.041116 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.041297 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.041427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.041951 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.042053 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.042306 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.042624 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.042785 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.042982 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.043239 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.043340 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.043605 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.043744 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.043915 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.044210 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.044303 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.044566 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.044715 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.044878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.045164 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.045299 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.045575 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.045673 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.045910 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.046103 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.046230 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.046538 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.046657 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.046860 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.046989 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.047231 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.047473 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.047583 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.047825 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.047925 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.048163 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.048341 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.048513 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.048727 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.048818 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.049137 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.049234 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.049472 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.049572 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.049809 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.050001 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.050126 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.051537 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.051659 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.051758 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.051843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.051933 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.052054 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.052054 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.053069 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.053179 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.053179 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.053351 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.053435 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.053516 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.053606 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.053698 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.053790 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.053874 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.053962 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.053962 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.054195 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.054290 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.054290 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.054516 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.054616 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.054880 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.055022 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.055210 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.055491 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.055649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.055837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.056123 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.056297 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.056567 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.056686 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.056796 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.057068 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.057172 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.057468 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.057586 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.057784 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.058024 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.058124 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.058437 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.058535 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.058763 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.058949 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.059098 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.059406 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.059507 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.059732 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.059903 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.060214 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.060356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.060461 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.060701 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.060846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.061021 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.061303 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.061394 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.061648 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.061797 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.061967 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.062252 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.062350 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.062587 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.062869 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.062968 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.063216 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.063374 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.063752 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.063849 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.064140 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.064387 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.064489 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.064765 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.064882 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.065085 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.065326 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.065418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.065707 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.065833 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.066026 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.066290 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.066392 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.066673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.066794 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.066963 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.067236 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.067337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.067611 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.067728 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.067944 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.068187 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.068324 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.068649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.068747 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.068969 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.069165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.069288 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.069606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.069698 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.069967 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.070115 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.070288 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.070554 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.070658 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.070904 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.071064 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.071226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.071523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.071623 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.071849 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.072036 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.072195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.072498 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.072590 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.072821 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.073161 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.073265 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.073543 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.073667 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.073864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.074112 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.074206 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.074501 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.074597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.074842 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.075054 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.075155 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.075476 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.075575 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.075797 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.075967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.076141 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.076427 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.076659 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.076878 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.076989 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.077301 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.077405 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.077649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.077870 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.077983 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.078268 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.078391 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.078579 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.078700 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.078901 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.078992 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.079209 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.079297 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.079521 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.079627 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.079837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.079935 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.080182 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.080297 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.080494 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.080593 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.080819 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.080916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.081138 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.081238 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.081448 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.081539 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.081772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.081870 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.082084 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.082187 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.082415 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.082626 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.082725 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.082988 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.083088 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.083316 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.083407 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.083623 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.083718 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.083969 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.084112 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.084307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.084413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.084619 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.084716 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.084950 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.085051 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.085264 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.085355 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.085576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.085672 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.085896 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.086001 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.086220 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.086317 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.086533 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.086625 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.086846 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.086953 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.087167 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.087277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.087473 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.087562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.087781 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.087878 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.088124 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.088231 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.088437 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.088530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.088771 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.088872 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.089085 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.089176 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.089400 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.089497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.089707 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.089798 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.090019 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.090116 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.090327 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.090430 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.090641 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.090740 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.090962 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.091063 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.091257 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.091359 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.091575 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.091673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.091881 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.091978 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.092227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.092332 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.092538 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.092634 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.092851 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.092948 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.093161 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.093266 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.093480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.093571 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.093815 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.093911 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.094145 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.094236 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.094461 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.094559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.094773 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.094878 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.095098 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.095196 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.095417 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.095507 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.095738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.095826 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.096083 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.096192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.096406 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.096504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.096729 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.096818 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.097052 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.097157 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.097378 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.097633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.097734 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.097976 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.098080 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.098304 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.098402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.098645 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.098735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.098982 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.099253 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.099344 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.099592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.099681 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.099897 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.099996 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.100259 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.100361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.100581 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.100680 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.100903 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.101002 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.101224 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.101314 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.101543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.101633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.101856 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.101947 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.102172 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.102264 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.102486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.102597 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.102799 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.102905 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.103117 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.103209 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.103431 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.103521 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.103747 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.103845 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.104086 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.104181 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.104457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.104567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.104783 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.104875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.105107 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.105202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.105442 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.105541 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.105765 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.105871 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.106079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.106175 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.106402 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.106492 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.106719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.106807 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.107035 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.107123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.107365 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.107473 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.107662 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.107760 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.107981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.108109 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.108326 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.108423 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.108646 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.108740 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.108957 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.109047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.109277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.109379 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.109602 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.109692 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.109941 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.110040 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.110281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.110372 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.110613 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.110703 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.110937 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.111035 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.111262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.111353 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.111582 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.111680 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.111914 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.112176 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.112281 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.112501 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.112600 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.112845 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.112945 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.113181 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.113286 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.113543 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.113858 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.113946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.114170 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.114262 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.114483 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.114579 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.114803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.114901 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.115130 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.115229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.115443 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.115538 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.115751 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.115849 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.116095 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.116189 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.116414 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.116516 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.116726 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.117003 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.117102 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.117329 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.117433 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.117636 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.117770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.117954 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.118046 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.118265 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.118356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.118578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.118803 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.118903 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.119159 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.119249 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.119480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.119603 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.119790 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.119911 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.120161 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.120266 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.120477 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.120575 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.120792 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.120891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.121110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.121266 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.121423 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.121517 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.121730 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.121824 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.122050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.122148 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.122369 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.122461 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.122681 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.122774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.122995 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.123092 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.123315 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.123459 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.123634 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.123726 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.123946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.124085 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.124292 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.124392 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.124607 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.124701 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.124929 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.125019 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.125255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.125379 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.125600 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.125708 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.125925 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.126024 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.126244 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.126354 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.126555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.126652 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.126873 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.126985 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.127185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.127275 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.127499 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.127586 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.127818 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.127908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.128155 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.128260 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.128475 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.128567 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.128789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.128886 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.129108 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.129207 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.129422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.129520 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.129745 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.129849 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.130064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.130162 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.130404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.130495 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.130721 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.130823 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.131038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.131134 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.131362 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.131467 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.131680 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.131794 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.132033 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.132147 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.132343 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.132434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.132665 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.132765 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.133001 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.133098 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.133335 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.133435 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.133655 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.133873 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.133992 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.134217 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.134315 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.134547 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.134671 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.134887 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.134977 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.135226 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.135316 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.135592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.135737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.135912 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.136096 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.136250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.136418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.136584 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.136733 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.136905 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.137003 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 03:48:22.137315 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.137636 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.137958 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.138275 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.138591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.138909 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.139227 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.139544 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.139867 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.140215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.140534 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.140898 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.141175 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.141528 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.141853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.142181 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.142503 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.142828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.143147 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.143465 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.143782 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.144126 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.144453 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.144793 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.145115 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.145427 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.145873 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.146194 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.146520 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.146848 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.147165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.147497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.147900 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.148168 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.148498 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.148818 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.149157 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.149507 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.149858 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.150192 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.150508 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.150819 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.151176 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.151500 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.152214 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.152525 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.152836 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.153148 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.153474 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.154224 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.154553 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.154873 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.155191 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.155513 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.155828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.156187 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.156490 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.156804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.157116 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.157430 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.157753 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.158066 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.158379 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.158695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.159008 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.159322 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.159675 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.160050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.160382 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.160715 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.161037 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.161368 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.161685 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.162018 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.162365 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.162688 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.163009 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.163353 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.163672 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.164014 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.164335 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.164655 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.164979 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.165297 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.165644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.165981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.166299 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.166638 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.167035 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.167367 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.167699 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.168033 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.168383 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.168704 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.169024 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.169350 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.169670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.169999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.170326 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.170651 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.170990 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.171326 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.171645 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.171980 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.172348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.172715 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.173044 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.173397 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.173734 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.174056 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.174377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.174698 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 03:48:22.174949 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 03:48:22.291774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO dbcounter [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] Registered counter for database nova_api Jul 12 03:48:22.312839 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_db.sqlalchemy.engines [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:48:22.319947 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writer thread running {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:48:22.330842 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO dbcounter [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] Registered counter for database nova_api Jul 12 03:48:22.351052 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_db.sqlalchemy.engines [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:48:22.358929 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writer thread running {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:48:22.376436 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.context [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05249ef8-00dc-42ee-b5c1-239ad6b1d9f7(cell1) {{(pid=124434) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 03:48:22.380418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:48:22.382019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:48:22.382841 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:48:22.384865 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:48:22.386908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO dbcounter [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] Registered counter for database nova_cell0 Jul 12 03:48:22.391058 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO dbcounter [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] Registered counter for database nova_cell1 Jul 12 03:48:22.398475 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_db.sqlalchemy.engines [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:48:22.400581 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_db.sqlalchemy.engines [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:48:22.408134 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writer thread running {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:48:22.409464 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writer thread running {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:48:22.416167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.context [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05249ef8-00dc-42ee-b5c1-239ad6b1d9f7(cell1) {{(pid=124435) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 03:48:22.420525 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:48:22.422120 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:48:22.422945 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:48:22.424966 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:48:22.427000 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO dbcounter [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] Registered counter for database nova_cell0 Jul 12 03:48:22.431187 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO dbcounter [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] Registered counter for database nova_cell1 Jul 12 03:48:22.439130 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_db.sqlalchemy.engines [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:48:22.440887 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_db.sqlalchemy.engines [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:48:22.446044 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writer thread running {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:48:22.451897 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writer thread running {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:48:22.556970 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO dbcounter [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] Registered counter for database nova_cell0 Jul 12 03:48:22.565579 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_db.sqlalchemy.engines [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:48:22.571707 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writer thread running {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:48:22.594980 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO dbcounter [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] Registered counter for database nova_cell0 Jul 12 03:48:22.602686 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_db.sqlalchemy.engines [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 03:48:22.608060 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writer thread running {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 03:48:22.898357 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: WARNING keystonemiddleware.auth_token [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 03:48:22.906427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: WARNING keystonemiddleware.auth_token [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 03:48:22.944115 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: WARNING keystonemiddleware.auth_token [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 03:48:22.951717 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: WARNING keystonemiddleware.auth_token [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 03:48:23.253268 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: WARNING keystonemiddleware.auth_token [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 03:48:23.259343 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: WARNING keystonemiddleware.auth_token [None req-2f5c4bcd-08de-4901-a275-54676583ae18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 03:48:23.264821 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cc90dd69c0 pid: 124434 (default app) Jul 12 03:48:23.305010 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: WARNING keystonemiddleware.auth_token [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 03:48:23.311148 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: WARNING keystonemiddleware.auth_token [None req-88caf17d-4a3f-4e7a-ba12-1376ce81b850 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 03:48:23.316452 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cc90dd69c0 pid: 124435 (default app) Jul 12 03:49:03.239055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=3 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:03.240805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=3 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:03.241552 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=3 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:03.242309 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=3 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:04.430495 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e1f88ba3-25c2-4d3b-9b64-aac2a86e037e tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Action: 'create', calling method: .version_select at 0x7fd7fc4bb700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1229096632"}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:04.590799 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=3 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:04.592534 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=3 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:04.593469 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=3 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:04.597590 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=3 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:06.044945 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-eb011f04-0343-4da6-9dbc-c2080c213664 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] Action: 'create', calling method: .version_select at 0x7fd7fc4ba5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1415731339", "metadata": {"Type": "work"}}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:06.248858 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e1f88ba3-25c2-4d3b-9b64-aac2a86e037e tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.022129 Jul 12 03:49:06.261660 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1154 bytes} [Tue Jul 12 03:49:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3041 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 03:49:06.272472 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1d27ad27-6c24-422a-ac56-005fe97c50b6 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fc380550>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:06.394485 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1d27ad27-6c24-422a-ac56-005fe97c50b6 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74" status: 200 len: 345 microversion: 2.1 time: 0.131382 Jul 12 03:49:06.395347 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 2/2] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:06 2022] GET /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74 => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:07.411665 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-264ef1c2-df9e-4b73-af84-63a102d54cbb tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fc380670>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:08.051407 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-264ef1c2-df9e-4b73-af84-63a102d54cbb tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74" status: 200 len: 346 microversion: 2.1 time: 0.645286 Jul 12 03:49:08.052016 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 3/3] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:07 2022] GET /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74 => generated 346 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 03:49:08.064225 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ae58f295-fc13-4d26-b48a-a8dab3f34850 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Action: 'create', calling method: .version_select at 0x7fd7fc380c10>, body: {"snapshot": {"volume_id": "c6aa2910-9adb-412e-9645-34d9e981ea74", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-941429809"}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:08.133123 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-eb011f04-0343-4da6-9dbc-c2080c213664 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.548718 Jul 12 03:49:08.140700 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 1/4] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 12 03:49:04 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3558 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 03:49:08.146528 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1c907b22-31a0-41d0-b7ea-55cf06dac141 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] Calling method '.version_select at 0x7fd7fc3834c0>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:08.323417 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1c907b22-31a0-41d0-b7ea-55cf06dac141 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1" status: 200 len: 353 microversion: 2.1 time: 0.181073 Jul 12 03:49:08.328926 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 2/5] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:08 2022] GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1 => generated 353 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:08.606095 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ae58f295-fc13-4d26-b48a-a8dab3f34850 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.545448 Jul 12 03:49:08.607882 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 4/6] 10.222.0.20 () {60 vars in 1161 bytes} [Tue Jul 12 03:49:08 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 03:49:08.619433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9715d16d-66a3-4d1e-b97f-48e882377e8d tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fc383670>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:08.812767 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9715d16d-66a3-4d1e-b97f-48e882377e8d tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3" status: 200 len: 286 microversion: 2.1 time: 0.197713 Jul 12 03:49:08.813679 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 03:49:08 2022] GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 => generated 286 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:08.824123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5405e0f6-fea2-4dac-a1cd-271c1e5e8f75 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fc397820>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:08.954760 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5405e0f6-fea2-4dac-a1cd-271c1e5e8f75 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.134814 Jul 12 03:49:08.955622 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1139 bytes} [Tue Jul 12 03:49:08 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:08.967855 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-13ec88ef-eaca-4520-80b9-75dace3a0c66 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fc383ca0>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:09.021516 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-13ec88ef-eaca-4520-80b9-75dace3a0c66 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3" status: 200 len: 286 microversion: 2.1 time: 0.058127 Jul 12 03:49:09.022449 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 4/9] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 03:49:08 2022] GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:09.340226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5b5ff925-b261-4b03-8a38-585f2f068bee tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] Calling method '.version_select at 0x7fd7fc397790>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:09.521099 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5b5ff925-b261-4b03-8a38-585f2f068bee tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1" status: 200 len: 354 microversion: 2.1 time: 0.189209 Jul 12 03:49:09.524863 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:09 2022] GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1 => generated 354 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:09.537017 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-025e6ab6-de64-4ffa-8206-91946dfbfe11 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] Calling method '.version_select at 0x7fd7fc39a3a0>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:10.031922 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-025e6ab6-de64-4ffa-8206-91946dfbfe11 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1" status: 200 len: 354 microversion: 2.1 time: 0.499254 Jul 12 03:49:10.036916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:09 2022] GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1 => generated 354 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:10.037873 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-236b4337-999d-4d67-bbdb-5ff1e604baa2 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fc397040>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:10.057887 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-84d4482b-c948-47ee-bc4a-624c7a1221d5 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] Calling method '.version_select at 0x7fd7fc383d30>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:10.108899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-236b4337-999d-4d67-bbdb-5ff1e604baa2 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3" status: 200 len: 286 microversion: 2.1 time: 0.075907 Jul 12 03:49:10.113245 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 03:49:10 2022] GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:10.244998 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-84d4482b-c948-47ee-bc4a-624c7a1221d5 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1" status: 202 len: 0 microversion: 2.1 time: 0.190870 Jul 12 03:49:10.245832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 03:49:10 2022] DELETE /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:49:10.254208 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8c097d2f-c808-4c89-b084-119d68a74b49 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] Calling method '.version_select at 0x7fd7fc380e50>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:10.374435 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8c097d2f-c808-4c89-b084-119d68a74b49 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1" status: 200 len: 353 microversion: 2.1 time: 0.124326 Jul 12 03:49:10.375559 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:10 2022] GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:11.122263 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e0b55f8e-6c55-4b17-98ce-7b514c78e0f7 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fc383550>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:11.194095 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e0b55f8e-6c55-4b17-98ce-7b514c78e0f7 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3" status: 200 len: 286 microversion: 2.1 time: 0.077111 Jul 12 03:49:11.198430 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 03:49:11 2022] GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:11.387970 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-3f75c33f-f33e-4f59-9d3b-fab41e8666f6 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] Calling method '.version_select at 0x7fd7fc397d30>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:11.512911 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-3f75c33f-f33e-4f59-9d3b-fab41e8666f6 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1" status: 200 len: 353 microversion: 2.1 time: 0.129582 Jul 12 03:49:11.518580 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:11 2022] GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:12.206386 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-eb6ddbd3-7569-4126-8fd9-ad9a5a606f47 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fc39a4c0>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:12.291948 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-eb6ddbd3-7569-4126-8fd9-ad9a5a606f47 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3" status: 200 len: 286 microversion: 2.1 time: 0.089094 Jul 12 03:49:12.292370 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 8/17] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 03:49:12 2022] GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:12.525882 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-12aeed13-e183-4b49-bb8c-7ba3ca66775b tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] Calling method '.version_select at 0x7fd7fc397670>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:12.627377 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-12aeed13-e183-4b49-bb8c-7ba3ca66775b tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1" status: 200 len: 353 microversion: 2.1 time: 0.105703 Jul 12 03:49:12.627947 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 10/18] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:12 2022] GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:13.303892 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-54d0c445-1b1d-4d05-8fa4-c42e5ce6a676 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fc383670>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:13.365914 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-54d0c445-1b1d-4d05-8fa4-c42e5ce6a676 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3" status: 200 len: 286 microversion: 2.1 time: 0.067023 Jul 12 03:49:13.367432 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 9/19] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 03:49:13 2022] GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:13.642951 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7242ad68-9d34-4306-b5e2-969136c512f0 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] Calling method '.version_select at 0x7fd7fc380430>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:13.746859 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7242ad68-9d34-4306-b5e2-969136c512f0 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1" status: 200 len: 353 microversion: 2.1 time: 0.108622 Jul 12 03:49:13.747434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 11/20] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:13 2022] GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1 => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:14.559324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-325837986", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:14.770709 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-268984611", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "networks": [{"uuid": "352cd507-1097-42cd-8b57-77a477f68965"}]}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:14.880802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.network.neutron [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] validate_networks() for [('8bb25d8f-4fca-43c0-92f4-dd80289def0e', None, None, None, None, None)] {{(pid=124435) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:49:15.046806 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.network.neutron [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] validate_networks() for [('352cd507-1097-42cd-8b57-77a477f68965', None, None, None, None, None)] {{(pid=124434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:49:16.943790 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Flavor limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:49:16.945495 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Image limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:49:16.946168 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Flavor pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:49:16.946798 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Image pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:49:16.947448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:49:16.971573 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:16.971963 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:16.972791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:16.973702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:17.026885 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Flavor limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:49:17.027433 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Image limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:49:17.027777 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Flavor pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:49:17.028529 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Image pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:49:17.028944 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:49:17.045808 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Getting quotas for project fd03cff94a1842d8811deafa0dce10f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:49:17.053570 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:17.054023 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:17.054815 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:17.055084 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Getting quotas for user 4ac2825db0c649cab6dcc2e27fbaf80d and project fd03cff94a1842d8811deafa0dce10f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:49:17.055247 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:17.081407 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Going to run 1 instances... {{(pid=124435) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:49:17.090725 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124435) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:49:17.096865 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Getting quotas for project 38b640d5f6734a6b95b46a6f9dd695ec. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:49:17.105525 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Getting quotas for user 70ea64f67f264b20a7c556c625a64f80 and project 38b640d5f6734a6b95b46a6f9dd695ec. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:49:17.118831 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Going to run 1 instances... {{(pid=124434) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:49:17.121763 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:49:17.263485 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7c612d9c-187b-4265-9911-c0f64e836cf9 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.129031 Jul 12 03:49:17.270234 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 12/21] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 03:49:17.280665 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2e42bc66-9438-4687-be40-71a3396193de tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fc2a75e0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:17.294709 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3bac01d9-bf97-4163-8198-23472c647a8e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.258043 Jul 12 03:49:17.295407 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 10/22] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:49:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 03:49:17.305305 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-43407d20-0957-4057-bf57-3ec4c01d8664 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] Calling method '.version_select at 0x7fd7fb22a0d0>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:17.354502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2e42bc66-9438-4687-be40-71a3396193de tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3" status: 200 len: 287 microversion: 2.1 time: 0.082126 Jul 12 03:49:17.356649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 13/23] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 03:49:17 2022] GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:17.435445 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-43407d20-0957-4057-bf57-3ec4c01d8664 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] HTTP exception thrown: Volume 2862f884-8853-4ff3-8429-ef4c11c808f1 could not be found. Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-43407d20-0957-4057-bf57-3ec4c01d8664 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] Request method failure captured: Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1 HTTP/1.1 Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO8wy1HkelfVHhnQP-BYkzNOIkthDqsq9gi78Uu5yFAKS1kpJseBHJMdIXIyEkxYybDcNDhhzy-DkwCev9u5wDR5oThiegQuopMLMe2rMTiFvYkSziy74Ydt02QVZNDWrXjCM6sk1tBWJGQ3W-8ZcwxQMwqXrLdhkymDdnJOLhT8tP4 Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 60bc2d22a5ee48d09fa2ef945593079c Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-VolumesGetTestJSON-961402379 Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:49:17.441250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_60bc2d22a5ee48d09fa2ef945593079c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/60bc2d22a5ee48d09fa2ef945593079c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/60bc2d22a5ee48d09fa2ef945593079c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/60bc2d22a5ee48d09fa2ef945593079c"}]}] Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-VolumesGetTestJSON-961402379 Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 60bc2d22a5ee48d09fa2ef945593079c Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-VolumesGetTestJSON-961402379 Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-VolumesGetTestJSON-961402379-project Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: ea57984dbdb442cb92b801d48586f176 Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-VolumesGetTestJSON-961402379-project Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Volume 2862f884-8853-4ff3-8429-ef4c11c808f1 could not be found. Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': '2862f884-8853-4ff3-8429-ef4c11c808f1'} Jul 12 03:49:17.442832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2862f884-8853-4ff3-8429-ef4c11c808f1 could not be found. (HTTP 404) (Request-ID: req-65f1fb3e-f302-401d-896f-b88cc8148e37) Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:17.451551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 03:49:17.453497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2862f884-8853-4ff3-8429-ef4c11c808f1 could not be found. Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 03:49:17.454595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:49:17.455657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2862f884-8853-4ff3-8429-ef4c11c808f1 could not be found. Jul 12 03:49:17.455657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:17.455657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:17.455657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:17.455657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:17.455657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:49:17.455657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:49:17.455657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:49:17.455657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:49:17.455657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2862f884-8853-4ff3-8429-ef4c11c808f1 could not be found. Jul 12 03:49:17.455657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:17.459715 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-43407d20-0957-4057-bf57-3ec4c01d8664 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] Returning 404 to user: Volume 2862f884-8853-4ff3-8429-ef4c11c808f1 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:49:17.459715 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-43407d20-0957-4057-bf57-3ec4c01d8664 tempest-VolumesGetTestJSON-961402379 tempest-VolumesGetTestJSON-961402379-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1" status: 404 len: 109 microversion: 2.1 time: 0.162799 Jul 12 03:49:17.460558 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 11/24] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:17 2022] GET /compute/v2.1/os-volumes/2862f884-8853-4ff3-8429-ef4c11c808f1 => generated 109 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:49:17.474290 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-993b01b3-8b30-4df5-ab0a-3628d6ec3ae8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:17.475077 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-993b01b3-8b30-4df5-ab0a-3628d6ec3ae8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:17.661102 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-993b01b3-8b30-4df5-ab0a-3628d6ec3ae8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:17.717988 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-993b01b3-8b30-4df5-ab0a-3628d6ec3ae8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1214 microversion: 2.1 time: 0.253610 Jul 12 03:49:17.721326 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 12/25] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:17 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1214 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:17.732200 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bd7562c4-90cc-49d8-9ea7-f43201b1194f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:17.733913 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-bd7562c4-90cc-49d8-9ea7-f43201b1194f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:17.779597 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b4feffaf-5ca9-4cb7-a2c1-cbc0687ad4e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Action: 'create', calling method: .version_select at 0x7fd7fc2a7c10>, body: {"keypair": {"name": "tempest-keypair-1064268308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWFokxI28xID6Uem/dFtHlzPVL6rEN6dU4p7D82WQdV/AI9OTnstVjaPaR8zqmLQEHRgHANw/Eg6CW1glGlhDpRz0KFUfdVj/CvvDI8njAVmS8Ka9TNSHWl02NCVoKCUw=="}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:17.847656 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-b4feffaf-5ca9-4cb7-a2c1-cbc0687ad4e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Getting quotas for project e9417b8011914e108ae00b5aa583ce50. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:49:17.853454 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bd7562c4-90cc-49d8-9ea7-f43201b1194f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:17.861946 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-b4feffaf-5ca9-4cb7-a2c1-cbc0687ad4e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Getting quotas for user bf67549bf7e443c6b77eaf71fb6b709c and project e9417b8011914e108ae00b5aa583ce50. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:49:17.866199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bd7562c4-90cc-49d8-9ea7-f43201b1194f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1221 microversion: 2.1 time: 0.143428 Jul 12 03:49:17.868326 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 13/26] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:17 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:17.887306 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c798b574-343b-4b79-ae20-822cbb83ce5b tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fb1afca0>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:17.966342 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b4feffaf-5ca9-4cb7-a2c1-cbc0687ad4e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.607748 Jul 12 03:49:17.967047 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 14/27] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Jul 12 03:49:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 610 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 03:49:18.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c798b574-343b-4b79-ae20-822cbb83ce5b tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3" status: 202 len: 0 microversion: 2.1 time: 0.187316 Jul 12 03:49:18.058769 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 14/28] 10.222.0.20 () {58 vars in 1253 bytes} [Tue Jul 12 03:49:17 2022] DELETE /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:49:18.068688 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-867bb84e-4cf4-4203-a027-78b81471aa1d tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fb236dc0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:18.144504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-867bb84e-4cf4-4203-a027-78b81471aa1d tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3" status: 200 len: 286 microversion: 2.1 time: 0.080808 Jul 12 03:49:18.145964 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 15/29] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 03:49:18 2022] GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:18.666375 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-21938820", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:18.739648 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7ddd228b-7599-4726-a91e-3bb3062cef47 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:18.741330 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7ddd228b-7599-4726-a91e-3bb3062cef47 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:18.800107 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.network.neutron [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] validate_networks() for [('8bb25d8f-4fca-43c0-92f4-dd80289def0e', None, None, None, None, None)] {{(pid=124435) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:49:19.049514 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7ddd228b-7599-4726-a91e-3bb3062cef47 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:19.096404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7ddd228b-7599-4726-a91e-3bb3062cef47 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1214 microversion: 2.1 time: 0.355540 Jul 12 03:49:19.097522 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 16/30] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:18 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1214 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:49:19.157806 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f6747f3f-aac0-41c1-8233-557f4a7253c1 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fb252dc0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:19.204906 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-f6747f3f-aac0-41c1-8233-557f4a7253c1 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] HTTP exception thrown: Snapshot 54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 could not be found. Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f6747f3f-aac0-41c1-8233-557f4a7253c1 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Request method failure captured: Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 HTTP/1.1 Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO8vT8zZUpLNMVX3lrNBywTXzqRSQE5bJLabQvknRdJn48JBk4ua06VrJondHfJone2wQ0q_6Q8rcjO1zECbqylNUb7FS_1z0l2J639zfaPSL-pCMj2Z9RNZxLzCYltHgft9w6AOqaTC36Am-2JWYB88gVzhftiLiauC2aDuQDjc4QM Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 3440ac7f7cb74b0292e846cdcd91c1d1 Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-920434729 Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 03:49:19.209337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3440ac7f7cb74b0292e846cdcd91c1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3440ac7f7cb74b0292e846cdcd91c1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3440ac7f7cb74b0292e846cdcd91c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3440ac7f7cb74b0292e846cdcd91c1d1"}]}] Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-VolumesSnapshotsTestJSON-920434729 Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 3440ac7f7cb74b0292e846cdcd91c1d1 Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-920434729 Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-VolumesSnapshotsTestJSON-920434729-project Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 249f1cf3635a45ec8181a2a7e2ef1c1c Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-VolumesSnapshotsTestJSON-920434729-project Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Snapshot 54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 could not be found. Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': '54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3'} Jul 12 03:49:19.210399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 could not be found. (HTTP 404) (Request-ID: req-948a22b3-d8c1-4e1f-ad79-c58703c98768) Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:19.211094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 03:49:19.211996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 could not be found. Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 12 03:49:19.212902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 could not be found. Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 could not be found. Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f6747f3f-aac0-41c1-8233-557f4a7253c1 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Returning 404 to user: Snapshot 54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:49:19.213788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f6747f3f-aac0-41c1-8233-557f4a7253c1 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3" status: 404 len: 111 microversion: 2.1 time: 0.056946 Jul 12 03:49:19.215793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 17/31] 10.222.0.20 () {58 vars in 1250 bytes} [Tue Jul 12 03:49:19 2022] GET /compute/v2.1/os-snapshots/54d0902c-5db8-4f2f-b6ad-6fc0ba4f87b3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 03:49:19.231881 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4a3a3b47-c821-41f1-b846-636059e0b386 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fcd659d0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:19.511551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4a3a3b47-c821-41f1-b846-636059e0b386 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74" status: 202 len: 0 microversion: 2.1 time: 0.294603 Jul 12 03:49:19.512141 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 18/32] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 03:49:19 2022] DELETE /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:49:19.520295 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b40422e3-33d8-4855-a868-ad6f797ba76b tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fc3a60d0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:19.733635 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b40422e3-33d8-4855-a868-ad6f797ba76b tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74" status: 200 len: 345 microversion: 2.1 time: 0.217106 Jul 12 03:49:19.734239 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 19/33] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:19 2022] GET /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74 => generated 345 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:19.819083 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Flavor limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:49:19.819604 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Image limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:49:19.819957 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Flavor pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:49:19.820392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Image pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:49:19.820805 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:49:19.838771 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:19.839282 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:19.840081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:19.840465 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:19.903935 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Getting quotas for project fd03cff94a1842d8811deafa0dce10f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:49:19.914385 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Getting quotas for user 4ac2825db0c649cab6dcc2e27fbaf80d and project fd03cff94a1842d8811deafa0dce10f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:49:19.954136 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Going to run 1 instances... {{(pid=124435) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:49:19.960980 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124435) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:49:20.106263 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6109d8b0-3720-412c-bf70-b790dd281b76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.445490 Jul 12 03:49:20.113121 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 15/34] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:49:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 03:49:20.122493 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7de350d3-c58b-4726-8291-23b4308ea4c6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:20.123702 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7de350d3-c58b-4726-8291-23b4308ea4c6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:20.156617 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3b2e08f7-5a8e-4d1b-b2aa-92d6e1026a66 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:20.157239 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3b2e08f7-5a8e-4d1b-b2aa-92d6e1026a66 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:20.445538 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3b2e08f7-5a8e-4d1b-b2aa-92d6e1026a66 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:20.455118 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3b2e08f7-5a8e-4d1b-b2aa-92d6e1026a66 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1220 microversion: 2.1 time: 0.326816 Jul 12 03:49:20.456765 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 16/35] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:20 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1220 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:20.652405 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7de350d3-c58b-4726-8291-23b4308ea4c6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:20.671988 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7de350d3-c58b-4726-8291-23b4308ea4c6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1214 microversion: 2.1 time: 0.553266 Jul 12 03:49:20.681688 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 20/36] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:20 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1214 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:20.746546 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-276d4b08-c0db-4bef-977c-041fc949b2b6 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fb1afe50>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:20.815615 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-276d4b08-c0db-4bef-977c-041fc949b2b6 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] HTTP exception thrown: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-276d4b08-c0db-4bef-977c-041fc949b2b6 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Request method failure captured: Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74 HTTP/1.1 Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO8vT8zZUpLNMVX3lrNBywTXzqRSQE5bJLabQvknRdJn48JBk4ua06VrJondHfJone2wQ0q_6Q8rcjO1zECbqylNUb7FS_1z0l2J639zfaPSL-pCMj2Z9RNZxLzCYltHgft9w6AOqaTC36Am-2JWYB88gVzhftiLiauC2aDuQDjc4QM Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 3440ac7f7cb74b0292e846cdcd91c1d1 Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-920434729 Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:49:20.817899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3440ac7f7cb74b0292e846cdcd91c1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3440ac7f7cb74b0292e846cdcd91c1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3440ac7f7cb74b0292e846cdcd91c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3440ac7f7cb74b0292e846cdcd91c1d1"}]}] Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-VolumesSnapshotsTestJSON-920434729 Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 3440ac7f7cb74b0292e846cdcd91c1d1 Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-920434729 Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-VolumesSnapshotsTestJSON-920434729-project Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 249f1cf3635a45ec8181a2a7e2ef1c1c Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-VolumesSnapshotsTestJSON-920434729-project Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'c6aa2910-9adb-412e-9645-34d9e981ea74'} Jul 12 03:49:20.818982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. (HTTP 404) (Request-ID: req-36f7cffc-5de5-4909-821d-1753ec045d29) Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:20.821422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 03:49:20.822390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 03:49:20.824597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-276d4b08-c0db-4bef-977c-041fc949b2b6 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Returning 404 to user: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-276d4b08-c0db-4bef-977c-041fc949b2b6 tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74" status: 404 len: 109 microversion: 2.1 time: 0.077156 Jul 12 03:49:20.825556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 17/37] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:20 2022] GET /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:49:20.838933 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8e8f0bd3-5825-44eb-9fb1-07e5a3ff3f5c tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fc3a6790>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:20.876838 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-8e8f0bd3-5825-44eb-9fb1-07e5a3ff3f5c tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] HTTP exception thrown: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8e8f0bd3-5825-44eb-9fb1-07e5a3ff3f5c tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Request method failure captured: Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: DELETE /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74 HTTP/1.1 Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO8vT8zZUpLNMVX3lrNBywTXzqRSQE5bJLabQvknRdJn48JBk4ua06VrJondHfJone2wQ0q_6Q8rcjO1zECbqylNUb7FS_1z0l2J639zfaPSL-pCMj2Z9RNZxLzCYltHgft9w6AOqaTC36Am-2JWYB88gVzhftiLiauC2aDuQDjc4QM Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 3440ac7f7cb74b0292e846cdcd91c1d1 Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-920434729 Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 03:49:20.880202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3440ac7f7cb74b0292e846cdcd91c1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3440ac7f7cb74b0292e846cdcd91c1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3440ac7f7cb74b0292e846cdcd91c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3440ac7f7cb74b0292e846cdcd91c1d1"}]}] Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-VolumesSnapshotsTestJSON-920434729 Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 3440ac7f7cb74b0292e846cdcd91c1d1 Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-920434729 Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-VolumesSnapshotsTestJSON-920434729-project Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 249f1cf3635a45ec8181a2a7e2ef1c1c Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-VolumesSnapshotsTestJSON-920434729-project Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'c6aa2910-9adb-412e-9645-34d9e981ea74'} Jul 12 03:49:20.881353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. (HTTP 404) (Request-ID: req-b0e260cb-284e-4d4c-9963-4064c3900a1e) Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:20.882000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 03:49:20.883012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 03:49:20.883913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:49:20.887457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.887457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.887457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:20.887457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.887457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:20.887457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:49:20.887457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:49:20.887457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:49:20.887457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:49:20.887457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.887457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.891003 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8e8f0bd3-5825-44eb-9fb1-07e5a3ff3f5c tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Returning 404 to user: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:49:20.892151 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8e8f0bd3-5825-44eb-9fb1-07e5a3ff3f5c tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74" status: 404 len: 109 microversion: 2.1 time: 0.059214 Jul 12 03:49:20.893326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 21/38] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 03:49:20 2022] DELETE /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 03:49:20.902110 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4a07a11a-8e96-4137-ae94-3de4b35041fe tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Calling method '.version_select at 0x7fd7fb223a60>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:20.954217 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-4a07a11a-8e96-4137-ae94-3de4b35041fe tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] HTTP exception thrown: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4a07a11a-8e96-4137-ae94-3de4b35041fe tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Request method failure captured: Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74 HTTP/1.1 Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO8vT8zZUpLNMVX3lrNBywTXzqRSQE5bJLabQvknRdJn48JBk4ua06VrJondHfJone2wQ0q_6Q8rcjO1zECbqylNUb7FS_1z0l2J639zfaPSL-pCMj2Z9RNZxLzCYltHgft9w6AOqaTC36Am-2JWYB88gVzhftiLiauC2aDuQDjc4QM Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 3440ac7f7cb74b0292e846cdcd91c1d1 Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-920434729 Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:49:20.957165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3440ac7f7cb74b0292e846cdcd91c1d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3440ac7f7cb74b0292e846cdcd91c1d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3440ac7f7cb74b0292e846cdcd91c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3440ac7f7cb74b0292e846cdcd91c1d1"}]}] Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-VolumesSnapshotsTestJSON-920434729 Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 3440ac7f7cb74b0292e846cdcd91c1d1 Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-920434729 Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-VolumesSnapshotsTestJSON-920434729-project Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 249f1cf3635a45ec8181a2a7e2ef1c1c Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-VolumesSnapshotsTestJSON-920434729-project Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'c6aa2910-9adb-412e-9645-34d9e981ea74'} Jul 12 03:49:20.958277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. (HTTP 404) (Request-ID: req-d8d16c69-5d8e-42e1-ad92-d920ddc82403) Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:20.958932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 03:49:20.959908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 03:49:20.960851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:49:20.961738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.961738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.961738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:49:20.961738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.961738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:49:20.961738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:49:20.961738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:49:20.961738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:49:20.961738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:49:20.961738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. Jul 12 03:49:20.961738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:49:20.967973 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4a07a11a-8e96-4137-ae94-3de4b35041fe tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] Returning 404 to user: Volume c6aa2910-9adb-412e-9645-34d9e981ea74 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:49:20.969084 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4a07a11a-8e96-4137-ae94-3de4b35041fe tempest-VolumesSnapshotsTestJSON-920434729 tempest-VolumesSnapshotsTestJSON-920434729-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74" status: 404 len: 109 microversion: 2.1 time: 0.071446 Jul 12 03:49:20.970214 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 18/39] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:49:20 2022] GET /compute/v2.1/os-volumes/c6aa2910-9adb-412e-9645-34d9e981ea74 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:49:21.475952 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-48968ed0-7476-4f3e-b7f3-1ce9cae9cd5a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:21.478058 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-48968ed0-7476-4f3e-b7f3-1ce9cae9cd5a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:21.502081 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-48968ed0-7476-4f3e-b7f3-1ce9cae9cd5a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:21.507241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-48968ed0-7476-4f3e-b7f3-1ce9cae9cd5a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:21.513923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-48968ed0-7476-4f3e-b7f3-1ce9cae9cd5a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:21.514574 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-48968ed0-7476-4f3e-b7f3-1ce9cae9cd5a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:21.695080 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7b08859d-dcec-4205-8e95-9cd0b54a8673 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:21.695748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7b08859d-dcec-4205-8e95-9cd0b54a8673 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:21.723917 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7b08859d-dcec-4205-8e95-9cd0b54a8673 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:21.727807 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7b08859d-dcec-4205-8e95-9cd0b54a8673 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:21.733301 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7b08859d-dcec-4205-8e95-9cd0b54a8673 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:21.738420 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7b08859d-dcec-4205-8e95-9cd0b54a8673 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:22.369344 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-7b08859d-dcec-4205-8e95-9cd0b54a8673 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:22.392789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7b08859d-dcec-4205-8e95-9cd0b54a8673 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1266 microversion: 2.1 time: 0.707455 Jul 12 03:49:22.407728 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 19/40] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:21 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1266 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:22.413493 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-48968ed0-7476-4f3e-b7f3-1ce9cae9cd5a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:22.442862 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-48968ed0-7476-4f3e-b7f3-1ce9cae9cd5a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1224 microversion: 2.1 time: 0.966658 Jul 12 03:49:22.446120 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:21 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1224 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:23.422751 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1fc710eb-97db-4b75-b856-9d34050fa60c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:23.423370 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1fc710eb-97db-4b75-b856-9d34050fa60c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:23.429810 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1fc710eb-97db-4b75-b856-9d34050fa60c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:23.430359 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1fc710eb-97db-4b75-b856-9d34050fa60c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:23.431021 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1fc710eb-97db-4b75-b856-9d34050fa60c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:23.431495 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1fc710eb-97db-4b75-b856-9d34050fa60c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:23.461624 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0d3bc958-bb70-4dd1-ab33-7b8b8d792cb1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:23.462131 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0d3bc958-bb70-4dd1-ab33-7b8b8d792cb1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:23.473487 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d3bc958-bb70-4dd1-ab33-7b8b8d792cb1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:23.473945 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d3bc958-bb70-4dd1-ab33-7b8b8d792cb1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:23.496348 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d3bc958-bb70-4dd1-ab33-7b8b8d792cb1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:23.497255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d3bc958-bb70-4dd1-ab33-7b8b8d792cb1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:23.707125 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0d3bc958-bb70-4dd1-ab33-7b8b8d792cb1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:23.718911 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0d3bc958-bb70-4dd1-ab33-7b8b8d792cb1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1278 microversion: 2.1 time: 0.261276 Jul 12 03:49:23.721349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 23/42] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:23 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1278 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:49:24.083283 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1fc710eb-97db-4b75-b856-9d34050fa60c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:24.100674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1fc710eb-97db-4b75-b856-9d34050fa60c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1272 microversion: 2.1 time: 0.681745 Jul 12 03:49:24.107272 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 20/43] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:23 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1272 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:24.739543 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a7a3866d-7c95-49de-993f-b49bcb1714a5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:24.740394 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a7a3866d-7c95-49de-993f-b49bcb1714a5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:24.761971 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a7a3866d-7c95-49de-993f-b49bcb1714a5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:24.766173 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a7a3866d-7c95-49de-993f-b49bcb1714a5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:24.767644 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a7a3866d-7c95-49de-993f-b49bcb1714a5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:24.768187 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a7a3866d-7c95-49de-993f-b49bcb1714a5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:25.124385 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9de284d5-9773-42b2-a686-4be1fa9be16c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:25.125117 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9de284d5-9773-42b2-a686-4be1fa9be16c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:25.144898 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9de284d5-9773-42b2-a686-4be1fa9be16c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:25.145358 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9de284d5-9773-42b2-a686-4be1fa9be16c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:25.150249 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9de284d5-9773-42b2-a686-4be1fa9be16c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:25.150791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9de284d5-9773-42b2-a686-4be1fa9be16c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:25.189415 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a7a3866d-7c95-49de-993f-b49bcb1714a5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:25.197748 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a7a3866d-7c95-49de-993f-b49bcb1714a5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1278 microversion: 2.1 time: 0.462789 Jul 12 03:49:25.207544 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 24/44] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:24 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1278 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:25.492534 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9de284d5-9773-42b2-a686-4be1fa9be16c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:25.502088 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9de284d5-9773-42b2-a686-4be1fa9be16c tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1272 microversion: 2.1 time: 0.381870 Jul 12 03:49:25.510370 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 21/45] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:25 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1272 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:26.222748 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e3a1d3d6-5029-4a68-b3b5-f3d432129cb5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:26.224616 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e3a1d3d6-5029-4a68-b3b5-f3d432129cb5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:26.252289 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e3a1d3d6-5029-4a68-b3b5-f3d432129cb5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:26.253365 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e3a1d3d6-5029-4a68-b3b5-f3d432129cb5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:26.253668 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e3a1d3d6-5029-4a68-b3b5-f3d432129cb5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:26.254113 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e3a1d3d6-5029-4a68-b3b5-f3d432129cb5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:26.526978 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d244653d-3919-4dec-a048-efe8c1ca5bd3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:26.527590 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d244653d-3919-4dec-a048-efe8c1ca5bd3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:26.553851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d244653d-3919-4dec-a048-efe8c1ca5bd3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:26.554312 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d244653d-3919-4dec-a048-efe8c1ca5bd3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:26.555102 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d244653d-3919-4dec-a048-efe8c1ca5bd3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:26.555538 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d244653d-3919-4dec-a048-efe8c1ca5bd3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:26.812772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e3a1d3d6-5029-4a68-b3b5-f3d432129cb5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:26.833376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e3a1d3d6-5029-4a68-b3b5-f3d432129cb5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1278 microversion: 2.1 time: 0.610078 Jul 12 03:49:26.847081 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 25/46] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:26 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1278 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:27.854100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1c737810-66c5-4452-a827-654b19814197 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:27.855816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1c737810-66c5-4452-a827-654b19814197 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:27.858185 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:27.891755 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1c737810-66c5-4452-a827-654b19814197 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:27.892771 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1c737810-66c5-4452-a827-654b19814197 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:27.905176 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1c737810-66c5-4452-a827-654b19814197 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:27.906621 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1c737810-66c5-4452-a827-654b19814197 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:28.232236 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1c737810-66c5-4452-a827-654b19814197 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:28.248223 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1c737810-66c5-4452-a827-654b19814197 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1278 microversion: 2.1 time: 0.395995 Jul 12 03:49:28.283667 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 26/47] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:27 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1278 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:29.152881 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d244653d-3919-4dec-a048-efe8c1ca5bd3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:29.193703 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d244653d-3919-4dec-a048-efe8c1ca5bd3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 2.668028 Jul 12 03:49:29.200047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 22/48] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:26 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 2676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:29.283844 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-780735f9-c705-4edc-971f-8ec9ee8645e5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:29.294396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-780735f9-c705-4edc-971f-8ec9ee8645e5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:29.335883 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-780735f9-c705-4edc-971f-8ec9ee8645e5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:29.338431 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-780735f9-c705-4edc-971f-8ec9ee8645e5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:29.346049 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-780735f9-c705-4edc-971f-8ec9ee8645e5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:29.352761 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-780735f9-c705-4edc-971f-8ec9ee8645e5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:29.779204 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-be66e71e-8655-4af1-ac51-19689730b77b req-ef832d28-2aad-447b-977f-ee6a209741a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f1cbdb-c631-4f89-b3c5-8e74819e942d", "tag": "9d25c1e9-86c8-4922-a334-9f6f33f80277"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:29.806085 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-be66e71e-8655-4af1-ac51-19689730b77b req-ef832d28-2aad-447b-977f-ee6a209741a1 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:29.806811 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-be66e71e-8655-4af1-ac51-19689730b77b req-ef832d28-2aad-447b-977f-ee6a209741a1 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:29.852808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-be66e71e-8655-4af1-ac51-19689730b77b req-ef832d28-2aad-447b-977f-ee6a209741a1 service nova] Creating event network-changed:9d25c1e9-86c8-4922-a334-9f6f33f80277 for instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d on hv-cinder-84773 Jul 12 03:49:29.853710 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-be66e71e-8655-4af1-ac51-19689730b77b req-ef832d28-2aad-447b-977f-ee6a209741a1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 03:49:29.855404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-eb69a944-1eb8-4b52-a829-2c7f03599c7e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:29.856072 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-eb69a944-1eb8-4b52-a829-2c7f03599c7e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:29.857058 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-eb69a944-1eb8-4b52-a829-2c7f03599c7e None None] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:29.857697 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-eb69a944-1eb8-4b52-a829-2c7f03599c7e None None] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:29.869556 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.compute.rpcapi [None req-eb69a944-1eb8-4b52-a829-2c7f03599c7e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 03:49:29.871118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-eb69a944-1eb8-4b52-a829-2c7f03599c7e None None] Releasing lock "compute-rpcapi-router" {{(pid=124434) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 03:49:29.871539 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=4 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:29.953439 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-eb69a944-1eb8-4b52-a829-2c7f03599c7e None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.870865 Jul 12 03:49:29.954050 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 27/49] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:29.966090 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1030391399", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f76dcd0-bea2-4820-bfd4-ddc4ed91af3b"}], "security_groups": [{"name": "tempest-securitygroup--475140189"}], "key_name": "tempest-keypair-1064268308", "user_data": "}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:30.222347 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-780735f9-c705-4edc-971f-8ec9ee8645e5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:30.237343 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-780735f9-c705-4edc-971f-8ec9ee8645e5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1278 microversion: 2.1 time: 0.962156 Jul 12 03:49:30.239397 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 23/50] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:29 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1278 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:30.254668 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b7aea288-2aa3-49da-9a95-6ab8dbd2a860 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:30.257568 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b7aea288-2aa3-49da-9a95-6ab8dbd2a860 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:30.285586 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b7aea288-2aa3-49da-9a95-6ab8dbd2a860 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:30.286227 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b7aea288-2aa3-49da-9a95-6ab8dbd2a860 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:30.298738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b7aea288-2aa3-49da-9a95-6ab8dbd2a860 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:30.300759 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b7aea288-2aa3-49da-9a95-6ab8dbd2a860 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:30.365765 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.network.neutron [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] validate_networks() for [('8f76dcd0-bea2-4820-bfd4-ddc4ed91af3b', None, None, None, None, None)] {{(pid=124434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:49:30.450885 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=18 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:30.664841 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=14 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:30.962383 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b7aea288-2aa3-49da-9a95-6ab8dbd2a860 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:30.974505 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b7aea288-2aa3-49da-9a95-6ab8dbd2a860 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.733503 Jul 12 03:49:30.993555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 24/51] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:30 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:31.259641 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2505a0ee-2d0f-4efd-82d9-9f0a74ac4933 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:31.262879 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-2505a0ee-2d0f-4efd-82d9-9f0a74ac4933 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:31.275449 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2505a0ee-2d0f-4efd-82d9-9f0a74ac4933 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:31.276202 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2505a0ee-2d0f-4efd-82d9-9f0a74ac4933 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:31.277545 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2505a0ee-2d0f-4efd-82d9-9f0a74ac4933 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:31.278117 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2505a0ee-2d0f-4efd-82d9-9f0a74ac4933 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:32.789200 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Flavor limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:49:32.790302 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Image limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:49:32.791149 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Flavor pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:49:32.791781 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Image pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:49:32.792427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:49:32.844172 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:32.844172 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:32.849427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:32.850015 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:32.967667 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Getting quotas for project e9417b8011914e108ae00b5aa583ce50. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:49:32.996784 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Getting quotas for user bf67549bf7e443c6b77eaf71fb6b709c and project e9417b8011914e108ae00b5aa583ce50. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:49:33.017456 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-2505a0ee-2d0f-4efd-82d9-9f0a74ac4933 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:33.036926 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-2505a0ee-2d0f-4efd-82d9-9f0a74ac4933 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 1.777733 Jul 12 03:49:33.037608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 25/52] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:31 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:33.043929 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a3f66b4a-97fc-48b5-a237-b8823fb946f1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:33.049384 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a3f66b4a-97fc-48b5-a237-b8823fb946f1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:33.063429 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Going to run 1 instances... {{(pid=124434) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:49:33.064233 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a3f66b4a-97fc-48b5-a237-b8823fb946f1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:33.064923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a3f66b4a-97fc-48b5-a237-b8823fb946f1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:33.067183 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a3f66b4a-97fc-48b5-a237-b8823fb946f1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:33.067817 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a3f66b4a-97fc-48b5-a237-b8823fb946f1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:33.070110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:49:33.229329 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0c149654-e48d-4ba0-8b64-05813b7316dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.273754 Jul 12 03:49:33.246691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 28/53] 10.222.0.20 () {62 vars in 1187 bytes} [Tue Jul 12 03:49:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 3292 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 03:49:33.260652 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9935fd01-fc78-4e7b-bd34-d4351fe158de tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:33.265837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-9935fd01-fc78-4e7b-bd34-d4351fe158de tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:33.376139 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9935fd01-fc78-4e7b-bd34-d4351fe158de tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:33.388877 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9935fd01-fc78-4e7b-bd34-d4351fe158de tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:33.392519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9935fd01-fc78-4e7b-bd34-d4351fe158de tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:33.399350 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9935fd01-fc78-4e7b-bd34-d4351fe158de tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1282 microversion: 2.20 time: 0.151263 Jul 12 03:49:33.422407 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 29/54] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:33 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:33.942787 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a3f66b4a-97fc-48b5-a237-b8823fb946f1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:33.966437 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a3f66b4a-97fc-48b5-a237-b8823fb946f1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.925433 Jul 12 03:49:33.966624 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 26/55] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:33 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:34.057674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0b6a6e61-60c5-4de6-8597-95b171ef718f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:34.060350 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0b6a6e61-60c5-4de6-8597-95b171ef718f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:34.064486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0b6a6e61-60c5-4de6-8597-95b171ef718f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:34.070015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0b6a6e61-60c5-4de6-8597-95b171ef718f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:34.071114 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0b6a6e61-60c5-4de6-8597-95b171ef718f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:34.071732 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0b6a6e61-60c5-4de6-8597-95b171ef718f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:34.175073 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-a7b79351-5462-4bef-93e3-422284b7059b req-a6a936c6-8b29-4a37-a691-b724cd8954ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02a9be9-245a-4206-b88e-e7f7b9162ce3", "tag": "6845f790-c764-4fae-adef-13d8d80d7354"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:34.196581 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-a7b79351-5462-4bef-93e3-422284b7059b req-a6a936c6-8b29-4a37-a691-b724cd8954ca service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:34.197213 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-a7b79351-5462-4bef-93e3-422284b7059b req-a6a936c6-8b29-4a37-a691-b724cd8954ca service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:34.225301 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-a7b79351-5462-4bef-93e3-422284b7059b req-a6a936c6-8b29-4a37-a691-b724cd8954ca service nova] Creating event network-changed:6845f790-c764-4fae-adef-13d8d80d7354 for instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 on hv-cinder-84773 Jul 12 03:49:34.239703 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-a7b79351-5462-4bef-93e3-422284b7059b req-a6a936c6-8b29-4a37-a691-b724cd8954ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.322235 Jul 12 03:49:34.241367 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 30/56] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 03:49:34.440586 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b262cbaf-69b5-4b1b-9b59-ed9dfd8ebfdd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:34.442939 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b262cbaf-69b5-4b1b-9b59-ed9dfd8ebfdd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:34.456820 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b262cbaf-69b5-4b1b-9b59-ed9dfd8ebfdd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:34.460809 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b262cbaf-69b5-4b1b-9b59-ed9dfd8ebfdd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:34.462899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b262cbaf-69b5-4b1b-9b59-ed9dfd8ebfdd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:34.465394 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b262cbaf-69b5-4b1b-9b59-ed9dfd8ebfdd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:34.513534 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0b6a6e61-60c5-4de6-8597-95b171ef718f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:34.536776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0b6a6e61-60c5-4de6-8597-95b171ef718f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.478477 Jul 12 03:49:34.537428 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 27/57] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:34 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:49:34.611865 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b262cbaf-69b5-4b1b-9b59-ed9dfd8ebfdd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:34.626283 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b262cbaf-69b5-4b1b-9b59-ed9dfd8ebfdd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:34.628114 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b262cbaf-69b5-4b1b-9b59-ed9dfd8ebfdd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:34.629290 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b262cbaf-69b5-4b1b-9b59-ed9dfd8ebfdd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1286 microversion: 2.20 time: 0.193550 Jul 12 03:49:34.636338 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 31/58] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:34 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:34.983612 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c7a18ddd-4777-4073-83e2-dc17c4e13747 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:34.984247 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c7a18ddd-4777-4073-83e2-dc17c4e13747 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:34.987239 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:34.992251 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c7a18ddd-4777-4073-83e2-dc17c4e13747 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:34.993015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c7a18ddd-4777-4073-83e2-dc17c4e13747 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:34.993782 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c7a18ddd-4777-4073-83e2-dc17c4e13747 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:34.994615 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c7a18ddd-4777-4073-83e2-dc17c4e13747 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:35.186318 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c7a18ddd-4777-4073-83e2-dc17c4e13747 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:35.194584 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c7a18ddd-4777-4073-83e2-dc17c4e13747 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.215031 Jul 12 03:49:35.203744 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 28/59] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:34 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:35.553504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-3888108d-80a6-433c-bf6b-2e876c61e738 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:35.554120 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-3888108d-80a6-433c-bf6b-2e876c61e738 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:35.562176 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3888108d-80a6-433c-bf6b-2e876c61e738 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:35.562638 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3888108d-80a6-433c-bf6b-2e876c61e738 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:35.563416 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3888108d-80a6-433c-bf6b-2e876c61e738 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:35.563861 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3888108d-80a6-433c-bf6b-2e876c61e738 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:35.647589 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-330d5c55-d9ca-44e4-93b9-272a944463b4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:35.648509 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-330d5c55-d9ca-44e4-93b9-272a944463b4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:35.654756 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-330d5c55-d9ca-44e4-93b9-272a944463b4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:35.655597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-330d5c55-d9ca-44e4-93b9-272a944463b4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:35.656831 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-330d5c55-d9ca-44e4-93b9-272a944463b4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:35.657472 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-330d5c55-d9ca-44e4-93b9-272a944463b4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:35.770100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-330d5c55-d9ca-44e4-93b9-272a944463b4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:35.787703 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-330d5c55-d9ca-44e4-93b9-272a944463b4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:35.794372 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-330d5c55-d9ca-44e4-93b9-272a944463b4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:35.795891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-330d5c55-d9ca-44e4-93b9-272a944463b4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1286 microversion: 2.20 time: 0.153041 Jul 12 03:49:35.800073 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 29/60] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:35 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1286 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:49:35.818436 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-3888108d-80a6-433c-bf6b-2e876c61e738 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:35.835832 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-3888108d-80a6-433c-bf6b-2e876c61e738 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.286087 Jul 12 03:49:35.836460 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 32/61] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:35 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:36.212429 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-26f70cd5-e8c8-4624-ab9b-3b353035fd03 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:36.213273 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-26f70cd5-e8c8-4624-ab9b-3b353035fd03 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:36.227884 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-26f70cd5-e8c8-4624-ab9b-3b353035fd03 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:36.228553 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-26f70cd5-e8c8-4624-ab9b-3b353035fd03 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:36.229834 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-26f70cd5-e8c8-4624-ab9b-3b353035fd03 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:36.231115 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-26f70cd5-e8c8-4624-ab9b-3b353035fd03 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:36.281105 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-0c8a61e5-ed55-4db5-9f95-2501d4f552a0 req-e6de4e80-8a31-4ccc-9cc1-639b98f7a69a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "150b0be7-7300-4733-a0bc-76a06ec8bf4e", "tag": "d0f7e295-9d5e-45ea-b61d-7a13f716e4ae"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:36.297909 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-0c8a61e5-ed55-4db5-9f95-2501d4f552a0 req-e6de4e80-8a31-4ccc-9cc1-639b98f7a69a service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:36.300523 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-0c8a61e5-ed55-4db5-9f95-2501d4f552a0 req-e6de4e80-8a31-4ccc-9cc1-639b98f7a69a service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:36.321237 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-0c8a61e5-ed55-4db5-9f95-2501d4f552a0 req-e6de4e80-8a31-4ccc-9cc1-639b98f7a69a service nova] Creating event network-changed:d0f7e295-9d5e-45ea-b61d-7a13f716e4ae for instance 150b0be7-7300-4733-a0bc-76a06ec8bf4e on hv-cinder-84773 Jul 12 03:49:36.334125 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-0c8a61e5-ed55-4db5-9f95-2501d4f552a0 req-e6de4e80-8a31-4ccc-9cc1-639b98f7a69a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058550 Jul 12 03:49:36.334749 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 33/62] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 03:49:36.413935 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-26f70cd5-e8c8-4624-ab9b-3b353035fd03 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:36.425221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-26f70cd5-e8c8-4624-ab9b-3b353035fd03 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.217438 Jul 12 03:49:36.426342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 30/63] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:36 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:36.816151 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-32b99ffe-6227-42b6-9e64-f5c9b966621a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:36.817431 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-32b99ffe-6227-42b6-9e64-f5c9b966621a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:36.824443 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-32b99ffe-6227-42b6-9e64-f5c9b966621a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:36.825235 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-32b99ffe-6227-42b6-9e64-f5c9b966621a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:36.826329 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-32b99ffe-6227-42b6-9e64-f5c9b966621a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:36.827213 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-32b99ffe-6227-42b6-9e64-f5c9b966621a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:36.855348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-958a49a8-269c-4720-b047-18110df8866d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:36.857025 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-958a49a8-269c-4720-b047-18110df8866d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:36.869940 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-958a49a8-269c-4720-b047-18110df8866d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:36.872966 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-958a49a8-269c-4720-b047-18110df8866d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:36.874643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-958a49a8-269c-4720-b047-18110df8866d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:36.878686 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-958a49a8-269c-4720-b047-18110df8866d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:36.907709 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-32b99ffe-6227-42b6-9e64-f5c9b966621a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:36.927410 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-32b99ffe-6227-42b6-9e64-f5c9b966621a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:36.932671 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-32b99ffe-6227-42b6-9e64-f5c9b966621a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:36.933840 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-32b99ffe-6227-42b6-9e64-f5c9b966621a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1286 microversion: 2.20 time: 0.122128 Jul 12 03:49:36.935228 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 34/64] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:36 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:37.103422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-958a49a8-269c-4720-b047-18110df8866d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:37.114377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-958a49a8-269c-4720-b047-18110df8866d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.264900 Jul 12 03:49:37.115345 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 31/65] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:36 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:49:37.442456 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f533b534-f5e0-4e49-96a4-3452b9a270ab tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:37.443304 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f533b534-f5e0-4e49-96a4-3452b9a270ab tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:37.453345 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f533b534-f5e0-4e49-96a4-3452b9a270ab tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:37.454019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f533b534-f5e0-4e49-96a4-3452b9a270ab tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:37.455056 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f533b534-f5e0-4e49-96a4-3452b9a270ab tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:37.456085 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f533b534-f5e0-4e49-96a4-3452b9a270ab tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:37.630937 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f533b534-f5e0-4e49-96a4-3452b9a270ab tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:37.638716 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f533b534-f5e0-4e49-96a4-3452b9a270ab tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.200455 Jul 12 03:49:37.639546 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 35/66] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:37 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:37.952745 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8024a85d-d7b1-43c5-8994-81e8a6d72693 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:37.953340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8024a85d-d7b1-43c5-8994-81e8a6d72693 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:37.959984 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8024a85d-d7b1-43c5-8994-81e8a6d72693 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:37.960818 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8024a85d-d7b1-43c5-8994-81e8a6d72693 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:37.961841 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8024a85d-d7b1-43c5-8994-81e8a6d72693 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:37.962475 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8024a85d-d7b1-43c5-8994-81e8a6d72693 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:38.131038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9f36ba9c-dc82-471e-bd11-d549f4631f70 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:38.132282 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-9f36ba9c-dc82-471e-bd11-d549f4631f70 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:38.144242 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9f36ba9c-dc82-471e-bd11-d549f4631f70 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:38.144851 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9f36ba9c-dc82-471e-bd11-d549f4631f70 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:38.147125 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9f36ba9c-dc82-471e-bd11-d549f4631f70 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:38.148330 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9f36ba9c-dc82-471e-bd11-d549f4631f70 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:38.265862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8024a85d-d7b1-43c5-8994-81e8a6d72693 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:38.275298 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8024a85d-d7b1-43c5-8994-81e8a6d72693 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:38.276840 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8024a85d-d7b1-43c5-8994-81e8a6d72693 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:38.283611 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8024a85d-d7b1-43c5-8994-81e8a6d72693 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1286 microversion: 2.20 time: 0.335498 Jul 12 03:49:38.287787 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 32/67] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:37 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1286 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:38.456526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9f36ba9c-dc82-471e-bd11-d549f4631f70 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:38.468458 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9f36ba9c-dc82-471e-bd11-d549f4631f70 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.341329 Jul 12 03:49:38.469669 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 36/68] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:38 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:38.657366 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f3c83cfd-c2b9-4418-b0f5-6ff723a8dfac tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:38.657901 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f3c83cfd-c2b9-4418-b0f5-6ff723a8dfac tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:38.672856 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f3c83cfd-c2b9-4418-b0f5-6ff723a8dfac tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:38.673531 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f3c83cfd-c2b9-4418-b0f5-6ff723a8dfac tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:38.679254 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f3c83cfd-c2b9-4418-b0f5-6ff723a8dfac tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:38.679254 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f3c83cfd-c2b9-4418-b0f5-6ff723a8dfac tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:39.136090 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f3c83cfd-c2b9-4418-b0f5-6ff723a8dfac tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:39.155690 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f3c83cfd-c2b9-4418-b0f5-6ff723a8dfac tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.503342 Jul 12 03:49:39.161370 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 33/69] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:38 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:39.310511 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1d2c12f5-3a33-4d93-9e7f-452f64e19795 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:39.312064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1d2c12f5-3a33-4d93-9e7f-452f64e19795 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:39.326181 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d2c12f5-3a33-4d93-9e7f-452f64e19795 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:39.328284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d2c12f5-3a33-4d93-9e7f-452f64e19795 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:39.331492 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d2c12f5-3a33-4d93-9e7f-452f64e19795 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:39.334432 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d2c12f5-3a33-4d93-9e7f-452f64e19795 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:39.478614 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1d2c12f5-3a33-4d93-9e7f-452f64e19795 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:39.487881 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d9091a20-32d7-4136-ad84-3de41b93a010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:39.488742 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d9091a20-32d7-4136-ad84-3de41b93a010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:39.491457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1d2c12f5-3a33-4d93-9e7f-452f64e19795 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:39.499346 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d9091a20-32d7-4136-ad84-3de41b93a010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:39.499690 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1d2c12f5-3a33-4d93-9e7f-452f64e19795 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:39.499802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d9091a20-32d7-4136-ad84-3de41b93a010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:39.500507 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d9091a20-32d7-4136-ad84-3de41b93a010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:39.500948 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d9091a20-32d7-4136-ad84-3de41b93a010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:39.501657 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1d2c12f5-3a33-4d93-9e7f-452f64e19795 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1286 microversion: 2.20 time: 0.196558 Jul 12 03:49:39.503674 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 37/70] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:39 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1286 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:39.860339 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d9091a20-32d7-4136-ad84-3de41b93a010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:39.870548 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=100 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:39.887031 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d9091a20-32d7-4136-ad84-3de41b93a010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.402130 Jul 12 03:49:39.890777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 34/71] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:39 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:49:40.178415 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-27d357d1-d539-4e2e-8ca0-aa855978d29d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:40.179482 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-27d357d1-d539-4e2e-8ca0-aa855978d29d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:40.195802 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-27d357d1-d539-4e2e-8ca0-aa855978d29d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:40.197355 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-27d357d1-d539-4e2e-8ca0-aa855978d29d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:40.200117 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-27d357d1-d539-4e2e-8ca0-aa855978d29d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:40.200718 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-27d357d1-d539-4e2e-8ca0-aa855978d29d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:40.522825 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5f5e8b12-7b56-4758-9463-d6d284fc083f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:40.523663 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5f5e8b12-7b56-4758-9463-d6d284fc083f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:40.538827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f5e8b12-7b56-4758-9463-d6d284fc083f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:40.540459 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f5e8b12-7b56-4758-9463-d6d284fc083f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:40.542273 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f5e8b12-7b56-4758-9463-d6d284fc083f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:40.544449 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f5e8b12-7b56-4758-9463-d6d284fc083f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:40.741555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5f5e8b12-7b56-4758-9463-d6d284fc083f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:40.744850 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-27d357d1-d539-4e2e-8ca0-aa855978d29d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:40.756338 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-27d357d1-d539-4e2e-8ca0-aa855978d29d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.580148 Jul 12 03:49:40.756338 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 38/72] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:40 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:40.767204 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5f5e8b12-7b56-4758-9463-d6d284fc083f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:40.769183 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5f5e8b12-7b56-4758-9463-d6d284fc083f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:40.770657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5f5e8b12-7b56-4758-9463-d6d284fc083f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1286 microversion: 2.20 time: 0.254296 Jul 12 03:49:40.782678 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 35/73] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:40 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1286 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:49:40.908888 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e6a67d51-6639-43d3-bf5f-f6315dbad344 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:40.909587 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e6a67d51-6639-43d3-bf5f-f6315dbad344 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:40.924792 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e6a67d51-6639-43d3-bf5f-f6315dbad344 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:40.925336 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e6a67d51-6639-43d3-bf5f-f6315dbad344 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:40.926193 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e6a67d51-6639-43d3-bf5f-f6315dbad344 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:40.928189 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e6a67d51-6639-43d3-bf5f-f6315dbad344 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:41.116131 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e6a67d51-6639-43d3-bf5f-f6315dbad344 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:41.125084 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e6a67d51-6639-43d3-bf5f-f6315dbad344 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.220704 Jul 12 03:49:41.126060 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 39/74] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:40 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:41.771460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3ae53d0f-fd86-4384-af30-59a49167479d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:41.772639 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3ae53d0f-fd86-4384-af30-59a49167479d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:41.780311 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3ae53d0f-fd86-4384-af30-59a49167479d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:41.780909 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3ae53d0f-fd86-4384-af30-59a49167479d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:41.781941 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3ae53d0f-fd86-4384-af30-59a49167479d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:41.782931 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3ae53d0f-fd86-4384-af30-59a49167479d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:41.798664 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4cff885d-af73-404e-a07c-41e93a21a279 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:41.800920 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4cff885d-af73-404e-a07c-41e93a21a279 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:41.814786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4cff885d-af73-404e-a07c-41e93a21a279 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:41.815718 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4cff885d-af73-404e-a07c-41e93a21a279 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:41.817209 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4cff885d-af73-404e-a07c-41e93a21a279 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:41.818008 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4cff885d-af73-404e-a07c-41e93a21a279 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:41.945565 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4cff885d-af73-404e-a07c-41e93a21a279 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:41.958444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4cff885d-af73-404e-a07c-41e93a21a279 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:41.962130 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4cff885d-af73-404e-a07c-41e93a21a279 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:41.966166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4cff885d-af73-404e-a07c-41e93a21a279 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1286 microversion: 2.20 time: 0.176029 Jul 12 03:49:41.968297 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 40/75] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:41 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1286 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:49:42.009660 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3ae53d0f-fd86-4384-af30-59a49167479d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:42.017189 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3ae53d0f-fd86-4384-af30-59a49167479d tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.250303 Jul 12 03:49:42.017980 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 36/76] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:41 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:42.142462 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-286a6542-ec7b-4e0e-8239-bcacff044c77 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:42.143517 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-286a6542-ec7b-4e0e-8239-bcacff044c77 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:42.150898 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-286a6542-ec7b-4e0e-8239-bcacff044c77 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:42.151347 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-286a6542-ec7b-4e0e-8239-bcacff044c77 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:42.152319 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-286a6542-ec7b-4e0e-8239-bcacff044c77 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:42.153137 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-286a6542-ec7b-4e0e-8239-bcacff044c77 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:42.175899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:42.314961 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-286a6542-ec7b-4e0e-8239-bcacff044c77 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:42.324495 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-286a6542-ec7b-4e0e-8239-bcacff044c77 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.186015 Jul 12 03:49:42.345008 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 41/77] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:42 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:42.987931 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b9cdc3a8-a925-4eee-8032-9b840c8ba31c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:42.987931 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b9cdc3a8-a925-4eee-8032-9b840c8ba31c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:42.993579 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b9cdc3a8-a925-4eee-8032-9b840c8ba31c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:42.994046 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b9cdc3a8-a925-4eee-8032-9b840c8ba31c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:42.994816 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b9cdc3a8-a925-4eee-8032-9b840c8ba31c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:42.995418 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b9cdc3a8-a925-4eee-8032-9b840c8ba31c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:43.032202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=4 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:43.036924 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cdd15139-fd50-4084-84c0-53d10c27df54 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:43.037536 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-cdd15139-fd50-4084-84c0-53d10c27df54 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:43.046270 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cdd15139-fd50-4084-84c0-53d10c27df54 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:43.046926 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cdd15139-fd50-4084-84c0-53d10c27df54 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:43.047857 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cdd15139-fd50-4084-84c0-53d10c27df54 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:43.048725 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cdd15139-fd50-4084-84c0-53d10c27df54 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:43.081160 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b9cdc3a8-a925-4eee-8032-9b840c8ba31c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:43.089729 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b9cdc3a8-a925-4eee-8032-9b840c8ba31c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:43.091340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b9cdc3a8-a925-4eee-8032-9b840c8ba31c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:43.092910 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b9cdc3a8-a925-4eee-8032-9b840c8ba31c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1286 microversion: 2.20 time: 0.110177 Jul 12 03:49:43.104062 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 37/78] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:42 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1286 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:43.208344 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cdd15139-fd50-4084-84c0-53d10c27df54 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:43.217182 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cdd15139-fd50-4084-84c0-53d10c27df54 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.185745 Jul 12 03:49:43.218145 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 42/79] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:43 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:43.342031 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-77d859ea-adae-4c56-b496-e40a87e404e8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:43.342680 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-77d859ea-adae-4c56-b496-e40a87e404e8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:43.348983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-77d859ea-adae-4c56-b496-e40a87e404e8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:43.349431 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-77d859ea-adae-4c56-b496-e40a87e404e8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:43.350364 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-77d859ea-adae-4c56-b496-e40a87e404e8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:43.351151 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-77d859ea-adae-4c56-b496-e40a87e404e8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:43.493281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-77d859ea-adae-4c56-b496-e40a87e404e8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:43.500924 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-77d859ea-adae-4c56-b496-e40a87e404e8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.162797 Jul 12 03:49:43.501591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 38/80] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:43 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:44.111551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4b553667-9de1-48a6-bc86-579ea66da115 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:44.112024 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4b553667-9de1-48a6-bc86-579ea66da115 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:44.114139 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=8 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:44.115199 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:44.123512 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4b553667-9de1-48a6-bc86-579ea66da115 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:44.123965 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4b553667-9de1-48a6-bc86-579ea66da115 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:44.124812 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4b553667-9de1-48a6-bc86-579ea66da115 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:44.125411 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4b553667-9de1-48a6-bc86-579ea66da115 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:44.235090 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8d52409b-f66a-4aa6-90e1-72374db6d3be tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:44.235666 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8d52409b-f66a-4aa6-90e1-72374db6d3be tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:44.242474 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d52409b-f66a-4aa6-90e1-72374db6d3be tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:44.242922 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d52409b-f66a-4aa6-90e1-72374db6d3be tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:44.243694 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d52409b-f66a-4aa6-90e1-72374db6d3be tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:44.244163 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d52409b-f66a-4aa6-90e1-72374db6d3be tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:44.379777 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4b553667-9de1-48a6-bc86-579ea66da115 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:44.388227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4b553667-9de1-48a6-bc86-579ea66da115 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:44.390009 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4b553667-9de1-48a6-bc86-579ea66da115 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:44.390911 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8d52409b-f66a-4aa6-90e1-72374db6d3be tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:44.391286 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4b553667-9de1-48a6-bc86-579ea66da115 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1286 microversion: 2.20 time: 0.284256 Jul 12 03:49:44.392294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 43/81] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:44 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1286 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:44.404804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8d52409b-f66a-4aa6-90e1-72374db6d3be tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.173735 Jul 12 03:49:44.405407 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 39/82] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:44 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:49:44.518430 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-591d2e50-0542-475f-9136-9756570f2723 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:44.519582 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-591d2e50-0542-475f-9136-9756570f2723 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:44.527065 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-591d2e50-0542-475f-9136-9756570f2723 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:44.527572 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-591d2e50-0542-475f-9136-9756570f2723 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:44.528368 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-591d2e50-0542-475f-9136-9756570f2723 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:44.528795 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-591d2e50-0542-475f-9136-9756570f2723 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:44.667899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-591d2e50-0542-475f-9136-9756570f2723 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:44.675918 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-591d2e50-0542-475f-9136-9756570f2723 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.161380 Jul 12 03:49:44.676748 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 44/83] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:44 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:45.411483 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0f7be61d-1599-4739-9a39-180b562e203e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:45.413104 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0f7be61d-1599-4739-9a39-180b562e203e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:45.425204 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5bac175b-d7bb-4970-99cf-91c98a9e047b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:45.426444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5bac175b-d7bb-4970-99cf-91c98a9e047b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:45.441439 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5bac175b-d7bb-4970-99cf-91c98a9e047b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:45.443847 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0f7be61d-1599-4739-9a39-180b562e203e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:45.444250 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5bac175b-d7bb-4970-99cf-91c98a9e047b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:45.445032 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5bac175b-d7bb-4970-99cf-91c98a9e047b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:45.445458 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5bac175b-d7bb-4970-99cf-91c98a9e047b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:45.449934 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0f7be61d-1599-4739-9a39-180b562e203e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:45.450900 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0f7be61d-1599-4739-9a39-180b562e203e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:45.454976 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0f7be61d-1599-4739-9a39-180b562e203e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:45.608313 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0f7be61d-1599-4739-9a39-180b562e203e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:45.621305 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0f7be61d-1599-4739-9a39-180b562e203e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:45.624484 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0f7be61d-1599-4739-9a39-180b562e203e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:45.627326 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0f7be61d-1599-4739-9a39-180b562e203e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1278 microversion: 2.20 time: 0.220703 Jul 12 03:49:45.629617 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 40/84] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:45 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:49:45.703210 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c94c0ce4-a789-4945-9c02-519c94ea0fa4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:45.705955 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c94c0ce4-a789-4945-9c02-519c94ea0fa4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:45.717772 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c94c0ce4-a789-4945-9c02-519c94ea0fa4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:45.718190 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c94c0ce4-a789-4945-9c02-519c94ea0fa4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:45.719202 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c94c0ce4-a789-4945-9c02-519c94ea0fa4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:45.729593 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c94c0ce4-a789-4945-9c02-519c94ea0fa4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:45.825200 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5bac175b-d7bb-4970-99cf-91c98a9e047b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:45.839260 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5bac175b-d7bb-4970-99cf-91c98a9e047b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.419132 Jul 12 03:49:45.839840 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 45/85] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:45 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:45.967004 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c94c0ce4-a789-4945-9c02-519c94ea0fa4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:45.975267 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c94c0ce4-a789-4945-9c02-519c94ea0fa4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.285530 Jul 12 03:49:45.976034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 41/86] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:45 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:46.651652 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b99d3ba6-1986-4bb6-99d4-a9a71be96b4d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:46.652409 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b99d3ba6-1986-4bb6-99d4-a9a71be96b4d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:46.659404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b99d3ba6-1986-4bb6-99d4-a9a71be96b4d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:46.660367 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b99d3ba6-1986-4bb6-99d4-a9a71be96b4d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:46.661207 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b99d3ba6-1986-4bb6-99d4-a9a71be96b4d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:46.661798 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b99d3ba6-1986-4bb6-99d4-a9a71be96b4d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:46.759051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b99d3ba6-1986-4bb6-99d4-a9a71be96b4d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:46.775249 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b99d3ba6-1986-4bb6-99d4-a9a71be96b4d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:46.776831 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b99d3ba6-1986-4bb6-99d4-a9a71be96b4d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:46.777975 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b99d3ba6-1986-4bb6-99d4-a9a71be96b4d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1334 microversion: 2.20 time: 0.130781 Jul 12 03:49:46.778547 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 46/87] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:46 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1334 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:46.855824 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-73eec48a-ecbd-4f96-8599-ffb6a0f367ca tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:46.857175 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-73eec48a-ecbd-4f96-8599-ffb6a0f367ca tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:46.864208 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-73eec48a-ecbd-4f96-8599-ffb6a0f367ca tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:46.864895 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-73eec48a-ecbd-4f96-8599-ffb6a0f367ca tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:46.865944 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-73eec48a-ecbd-4f96-8599-ffb6a0f367ca tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:46.866693 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-73eec48a-ecbd-4f96-8599-ffb6a0f367ca tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:46.993169 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8d755bb4-6a64-4345-9788-5ac64c75d54d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:46.993994 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8d755bb4-6a64-4345-9788-5ac64c75d54d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:47.005588 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8d755bb4-6a64-4345-9788-5ac64c75d54d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:47.006566 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8d755bb4-6a64-4345-9788-5ac64c75d54d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:47.009188 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8d755bb4-6a64-4345-9788-5ac64c75d54d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:47.010274 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8d755bb4-6a64-4345-9788-5ac64c75d54d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:47.050302 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-73eec48a-ecbd-4f96-8599-ffb6a0f367ca tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:47.061306 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-73eec48a-ecbd-4f96-8599-ffb6a0f367ca tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.209480 Jul 12 03:49:47.061893 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 42/88] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:46 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:49:47.224485 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8d755bb4-6a64-4345-9788-5ac64c75d54d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:47.233792 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8d755bb4-6a64-4345-9788-5ac64c75d54d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.245173 Jul 12 03:49:47.234845 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 47/89] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:46 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:47.797292 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-082dc351-fe26-48fd-91b0-96d71463bac5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:47.797899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-082dc351-fe26-48fd-91b0-96d71463bac5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:47.808079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-082dc351-fe26-48fd-91b0-96d71463bac5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:47.810209 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-082dc351-fe26-48fd-91b0-96d71463bac5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:47.813058 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-082dc351-fe26-48fd-91b0-96d71463bac5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:47.815917 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-082dc351-fe26-48fd-91b0-96d71463bac5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:47.965940 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-082dc351-fe26-48fd-91b0-96d71463bac5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:47.980863 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-082dc351-fe26-48fd-91b0-96d71463bac5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:47.980863 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-082dc351-fe26-48fd-91b0-96d71463bac5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:47.982243 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-082dc351-fe26-48fd-91b0-96d71463bac5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1334 microversion: 2.20 time: 0.187032 Jul 12 03:49:47.983024 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 43/90] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:47 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1334 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:48.082189 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f7ee6e21-1b45-491e-89c3-ae1dc7860293 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:48.082988 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f7ee6e21-1b45-491e-89c3-ae1dc7860293 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:48.091651 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f7ee6e21-1b45-491e-89c3-ae1dc7860293 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:48.092301 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f7ee6e21-1b45-491e-89c3-ae1dc7860293 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:48.093803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f7ee6e21-1b45-491e-89c3-ae1dc7860293 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:48.094289 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f7ee6e21-1b45-491e-89c3-ae1dc7860293 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:48.266199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f893760c-c7a9-4020-b061-1802e04da8b8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:48.267142 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f893760c-c7a9-4020-b061-1802e04da8b8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:48.290497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f893760c-c7a9-4020-b061-1802e04da8b8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:48.290870 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f893760c-c7a9-4020-b061-1802e04da8b8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:48.299396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f893760c-c7a9-4020-b061-1802e04da8b8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:48.299836 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f893760c-c7a9-4020-b061-1802e04da8b8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:48.371198 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f7ee6e21-1b45-491e-89c3-ae1dc7860293 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:48.383900 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f7ee6e21-1b45-491e-89c3-ae1dc7860293 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.308383 Jul 12 03:49:48.385139 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 48/91] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:48 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:48.531936 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f893760c-c7a9-4020-b061-1802e04da8b8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:48.547346 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f893760c-c7a9-4020-b061-1802e04da8b8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.295129 Jul 12 03:49:48.549398 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 44/92] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:48 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:49.007910 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1ff7bc7e-1ff2-4f01-add4-1f8e3d91083d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:49.008797 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1ff7bc7e-1ff2-4f01-add4-1f8e3d91083d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:49.027391 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1ff7bc7e-1ff2-4f01-add4-1f8e3d91083d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:49.031202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1ff7bc7e-1ff2-4f01-add4-1f8e3d91083d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:49.034467 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1ff7bc7e-1ff2-4f01-add4-1f8e3d91083d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:49.035189 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1ff7bc7e-1ff2-4f01-add4-1f8e3d91083d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:49.161194 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1ff7bc7e-1ff2-4f01-add4-1f8e3d91083d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:49.178555 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1ff7bc7e-1ff2-4f01-add4-1f8e3d91083d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:49.191083 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1ff7bc7e-1ff2-4f01-add4-1f8e3d91083d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:49.193890 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1ff7bc7e-1ff2-4f01-add4-1f8e3d91083d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1340 microversion: 2.20 time: 0.194479 Jul 12 03:49:49.194834 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 49/93] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:48 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1340 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:49.403805 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e38074dd-fcef-44fb-9bc5-a09c7ab98ba1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:49.404503 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e38074dd-fcef-44fb-9bc5-a09c7ab98ba1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:49.417991 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e38074dd-fcef-44fb-9bc5-a09c7ab98ba1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:49.418604 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e38074dd-fcef-44fb-9bc5-a09c7ab98ba1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:49.419531 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e38074dd-fcef-44fb-9bc5-a09c7ab98ba1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:49.422482 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e38074dd-fcef-44fb-9bc5-a09c7ab98ba1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:49.567561 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8f446843-0b3e-493f-8ee4-986b9e8217f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:49.568509 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8f446843-0b3e-493f-8ee4-986b9e8217f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:49.578267 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8f446843-0b3e-493f-8ee4-986b9e8217f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:49.579223 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8f446843-0b3e-493f-8ee4-986b9e8217f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:49.580421 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8f446843-0b3e-493f-8ee4-986b9e8217f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:49.581899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8f446843-0b3e-493f-8ee4-986b9e8217f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:49.718539 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e38074dd-fcef-44fb-9bc5-a09c7ab98ba1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:49.735157 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e38074dd-fcef-44fb-9bc5-a09c7ab98ba1 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.328821 Jul 12 03:49:49.751983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 45/94] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:49 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:49.849440 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8f446843-0b3e-493f-8ee4-986b9e8217f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:49.857677 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8f446843-0b3e-493f-8ee4-986b9e8217f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.296725 Jul 12 03:49:49.858251 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 50/95] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:49 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:49:50.215927 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-af931ded-4d64-4e6b-9f95-618ea8d23fec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:50.217720 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-af931ded-4d64-4e6b-9f95-618ea8d23fec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:50.226931 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-af931ded-4d64-4e6b-9f95-618ea8d23fec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:50.227491 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-af931ded-4d64-4e6b-9f95-618ea8d23fec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:50.228398 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-af931ded-4d64-4e6b-9f95-618ea8d23fec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:50.228957 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-af931ded-4d64-4e6b-9f95-618ea8d23fec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:50.307241 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-af931ded-4d64-4e6b-9f95-618ea8d23fec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:50.315881 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-af931ded-4d64-4e6b-9f95-618ea8d23fec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:50.317935 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-af931ded-4d64-4e6b-9f95-618ea8d23fec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:50.319362 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-af931ded-4d64-4e6b-9f95-618ea8d23fec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1340 microversion: 2.20 time: 0.109826 Jul 12 03:49:50.320111 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 46/96] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:50 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1340 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:50.755431 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-265d25c2-a61c-4684-a2f2-20960d0f1874 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:50.756507 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-265d25c2-a61c-4684-a2f2-20960d0f1874 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:50.763514 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-265d25c2-a61c-4684-a2f2-20960d0f1874 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:50.764063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-265d25c2-a61c-4684-a2f2-20960d0f1874 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:50.764901 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-265d25c2-a61c-4684-a2f2-20960d0f1874 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:50.765410 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-265d25c2-a61c-4684-a2f2-20960d0f1874 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:50.879083 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6c0441d1-b6e2-40d9-ad1d-0a0f64e2da55 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:50.879973 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6c0441d1-b6e2-40d9-ad1d-0a0f64e2da55 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:50.895824 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6c0441d1-b6e2-40d9-ad1d-0a0f64e2da55 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:50.896298 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6c0441d1-b6e2-40d9-ad1d-0a0f64e2da55 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:50.897065 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6c0441d1-b6e2-40d9-ad1d-0a0f64e2da55 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:50.897491 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6c0441d1-b6e2-40d9-ad1d-0a0f64e2da55 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:50.983779 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-265d25c2-a61c-4684-a2f2-20960d0f1874 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:50.995014 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-265d25c2-a61c-4684-a2f2-20960d0f1874 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.246307 Jul 12 03:49:50.999090 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 51/97] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:50 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:51.097864 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6c0441d1-b6e2-40d9-ad1d-0a0f64e2da55 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:51.107408 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6c0441d1-b6e2-40d9-ad1d-0a0f64e2da55 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.236040 Jul 12 03:49:51.107937 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 47/98] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:50 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:51.339489 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1eaf5ffd-c077-43e2-bbd0-84599ed42cb6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:51.340191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1eaf5ffd-c077-43e2-bbd0-84599ed42cb6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:51.349604 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1eaf5ffd-c077-43e2-bbd0-84599ed42cb6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:51.350058 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1eaf5ffd-c077-43e2-bbd0-84599ed42cb6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:51.350813 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1eaf5ffd-c077-43e2-bbd0-84599ed42cb6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:51.351251 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1eaf5ffd-c077-43e2-bbd0-84599ed42cb6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:51.524732 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1eaf5ffd-c077-43e2-bbd0-84599ed42cb6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:51.534745 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1eaf5ffd-c077-43e2-bbd0-84599ed42cb6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:51.537634 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1eaf5ffd-c077-43e2-bbd0-84599ed42cb6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:51.542465 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1eaf5ffd-c077-43e2-bbd0-84599ed42cb6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1340 microversion: 2.20 time: 0.207183 Jul 12 03:49:51.543878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 52/99] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:51 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1340 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:52.016778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-62e9bf04-aabe-4281-af7e-9bc3f05bab36 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:52.017443 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-62e9bf04-aabe-4281-af7e-9bc3f05bab36 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:52.028047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-62e9bf04-aabe-4281-af7e-9bc3f05bab36 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:52.031856 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-62e9bf04-aabe-4281-af7e-9bc3f05bab36 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:52.032952 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-62e9bf04-aabe-4281-af7e-9bc3f05bab36 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:52.033472 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-62e9bf04-aabe-4281-af7e-9bc3f05bab36 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:52.324831 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-62e9bf04-aabe-4281-af7e-9bc3f05bab36 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:52.340433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-62e9bf04-aabe-4281-af7e-9bc3f05bab36 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.328881 Jul 12 03:49:52.349954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 48/100] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:52 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:52.349954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-11df8b99-890c-47f3-9913-37b506c438e4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:52.349954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-11df8b99-890c-47f3-9913-37b506c438e4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:52.363634 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11df8b99-890c-47f3-9913-37b506c438e4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:52.364142 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11df8b99-890c-47f3-9913-37b506c438e4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:52.364960 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11df8b99-890c-47f3-9913-37b506c438e4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:52.365758 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11df8b99-890c-47f3-9913-37b506c438e4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:52.494479 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-e9929fd9-bcb4-4293-9a1d-3c311846b1cd req-7153aabc-9f5c-48dd-be35-e6df8006e3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f1cbdb-c631-4f89-b3c5-8e74819e942d", "name": "network-vif-plugged", "status": "completed", "tag": "9d25c1e9-86c8-4922-a334-9f6f33f80277"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:52.507044 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-e9929fd9-bcb4-4293-9a1d-3c311846b1cd req-7153aabc-9f5c-48dd-be35-e6df8006e3f6 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:52.507805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-e9929fd9-bcb4-4293-9a1d-3c311846b1cd req-7153aabc-9f5c-48dd-be35-e6df8006e3f6 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:52.521197 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-e9929fd9-bcb4-4293-9a1d-3c311846b1cd req-7153aabc-9f5c-48dd-be35-e6df8006e3f6 service nova] Creating event network-vif-plugged:9d25c1e9-86c8-4922-a334-9f6f33f80277 for instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d on hv-cinder-84773 Jul 12 03:49:52.527594 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-e9929fd9-bcb4-4293-9a1d-3c311846b1cd req-7153aabc-9f5c-48dd-be35-e6df8006e3f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.415037 Jul 12 03:49:52.528577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 53/101] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 03:49:52.568863 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d69c63e2-9dd8-4897-a35a-5be3a15bb2a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:52.573031 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d69c63e2-9dd8-4897-a35a-5be3a15bb2a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:52.584948 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d69c63e2-9dd8-4897-a35a-5be3a15bb2a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:52.585665 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d69c63e2-9dd8-4897-a35a-5be3a15bb2a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:52.587256 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d69c63e2-9dd8-4897-a35a-5be3a15bb2a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:52.589036 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d69c63e2-9dd8-4897-a35a-5be3a15bb2a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:52.638145 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-11df8b99-890c-47f3-9913-37b506c438e4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:52.670011 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-11df8b99-890c-47f3-9913-37b506c438e4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.327767 Jul 12 03:49:52.670519 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 49/102] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:52 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:52.833827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d69c63e2-9dd8-4897-a35a-5be3a15bb2a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:52.843675 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d69c63e2-9dd8-4897-a35a-5be3a15bb2a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:52.845601 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d69c63e2-9dd8-4897-a35a-5be3a15bb2a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:52.846992 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d69c63e2-9dd8-4897-a35a-5be3a15bb2a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.289264 Jul 12 03:49:52.847937 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 54/103] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:52 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:49:53.359019 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bba1be73-0423-432c-85b8-d5c49ef12296 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:53.359629 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-bba1be73-0423-432c-85b8-d5c49ef12296 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:53.367462 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bba1be73-0423-432c-85b8-d5c49ef12296 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:53.368834 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bba1be73-0423-432c-85b8-d5c49ef12296 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:53.371537 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bba1be73-0423-432c-85b8-d5c49ef12296 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:53.372507 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bba1be73-0423-432c-85b8-d5c49ef12296 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:53.622341 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bba1be73-0423-432c-85b8-d5c49ef12296 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:53.641828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bba1be73-0423-432c-85b8-d5c49ef12296 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.285489 Jul 12 03:49:53.652295 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 50/104] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:53 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:53.687020 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-059862c0-c513-4aef-88f0-b7c12e790bce tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:53.688564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-059862c0-c513-4aef-88f0-b7c12e790bce tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:53.697324 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-059862c0-c513-4aef-88f0-b7c12e790bce tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:53.698926 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-059862c0-c513-4aef-88f0-b7c12e790bce tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:53.700144 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-059862c0-c513-4aef-88f0-b7c12e790bce tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:53.700733 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-059862c0-c513-4aef-88f0-b7c12e790bce tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:53.865880 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-859e7c81-d6be-4810-a69f-69155831d9e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:53.867358 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-859e7c81-d6be-4810-a69f-69155831d9e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:53.879103 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-859e7c81-d6be-4810-a69f-69155831d9e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:53.879902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-859e7c81-d6be-4810-a69f-69155831d9e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:53.881466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-859e7c81-d6be-4810-a69f-69155831d9e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:53.882271 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-859e7c81-d6be-4810-a69f-69155831d9e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:53.940397 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=100 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:53.998344 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-059862c0-c513-4aef-88f0-b7c12e790bce tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:54.013527 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-059862c0-c513-4aef-88f0-b7c12e790bce tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.325244 Jul 12 03:49:54.014611 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 55/105] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:53 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:54.642986 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-859e7c81-d6be-4810-a69f-69155831d9e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:54.656976 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-859e7c81-d6be-4810-a69f-69155831d9e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:54.659310 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-78bff667-08d6-445d-8c4a-423eb7e6cdf6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:54.660336 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-78bff667-08d6-445d-8c4a-423eb7e6cdf6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:54.660862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-859e7c81-d6be-4810-a69f-69155831d9e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:54.664620 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-859e7c81-d6be-4810-a69f-69155831d9e6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.803210 Jul 12 03:49:54.665300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 51/106] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:53 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:54.681572 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78bff667-08d6-445d-8c4a-423eb7e6cdf6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:54.682036 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78bff667-08d6-445d-8c4a-423eb7e6cdf6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:54.682800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78bff667-08d6-445d-8c4a-423eb7e6cdf6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:54.683239 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78bff667-08d6-445d-8c4a-423eb7e6cdf6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:54.892740 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-78bff667-08d6-445d-8c4a-423eb7e6cdf6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:54.906120 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-78bff667-08d6-445d-8c4a-423eb7e6cdf6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.250014 Jul 12 03:49:54.916166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 56/107] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:54 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:49:55.030896 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6a7906d7-d393-4f72-aaa9-0039d4f76847 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:55.031504 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6a7906d7-d393-4f72-aaa9-0039d4f76847 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:55.049712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a7906d7-d393-4f72-aaa9-0039d4f76847 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:55.050168 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a7906d7-d393-4f72-aaa9-0039d4f76847 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:55.050991 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a7906d7-d393-4f72-aaa9-0039d4f76847 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:55.051429 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a7906d7-d393-4f72-aaa9-0039d4f76847 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:55.303264 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6a7906d7-d393-4f72-aaa9-0039d4f76847 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:55.315698 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6a7906d7-d393-4f72-aaa9-0039d4f76847 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.288721 Jul 12 03:49:55.316445 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 52/108] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:55 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:55.486312 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-16d6a676-ebc5-4157-9bd2-ee17e22d1e95 req-57e10297-fb6e-4717-b49f-15eac64d5bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae771f5b-03de-46db-82fc-cd94d731405a", "tag": "28823cfb-b758-4345-b841-353bcf53f8b8"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:55.499907 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-16d6a676-ebc5-4157-9bd2-ee17e22d1e95 req-57e10297-fb6e-4717-b49f-15eac64d5bde service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:55.500663 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-16d6a676-ebc5-4157-9bd2-ee17e22d1e95 req-57e10297-fb6e-4717-b49f-15eac64d5bde service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:55.516107 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-16d6a676-ebc5-4157-9bd2-ee17e22d1e95 req-57e10297-fb6e-4717-b49f-15eac64d5bde service nova] Creating event network-changed:28823cfb-b758-4345-b841-353bcf53f8b8 for instance ae771f5b-03de-46db-82fc-cd94d731405a on hv-cinder-84773 Jul 12 03:49:55.522397 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-16d6a676-ebc5-4157-9bd2-ee17e22d1e95 req-57e10297-fb6e-4717-b49f-15eac64d5bde service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041058 Jul 12 03:49:55.526441 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 57/109] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 03:49:55.688269 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-08fa8837-5ba0-4d23-8954-e18d9e48ed9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:55.688880 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-08fa8837-5ba0-4d23-8954-e18d9e48ed9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:55.700564 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-08fa8837-5ba0-4d23-8954-e18d9e48ed9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:55.701156 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-08fa8837-5ba0-4d23-8954-e18d9e48ed9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:55.703009 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-08fa8837-5ba0-4d23-8954-e18d9e48ed9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:55.703670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-08fa8837-5ba0-4d23-8954-e18d9e48ed9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:55.923248 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-270171cc-ca55-4c78-9c19-219f9a2bf9b0 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:55.924771 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-270171cc-ca55-4c78-9c19-219f9a2bf9b0 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:55.937967 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-270171cc-ca55-4c78-9c19-219f9a2bf9b0 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:55.938715 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-270171cc-ca55-4c78-9c19-219f9a2bf9b0 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:55.939831 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-270171cc-ca55-4c78-9c19-219f9a2bf9b0 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:55.940462 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-270171cc-ca55-4c78-9c19-219f9a2bf9b0 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:56.313795 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-08fa8837-5ba0-4d23-8954-e18d9e48ed9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:56.326690 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-08fa8837-5ba0-4d23-8954-e18d9e48ed9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:56.358909 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-08fa8837-5ba0-4d23-8954-e18d9e48ed9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:56.364722 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-08fa8837-5ba0-4d23-8954-e18d9e48ed9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.685683 Jul 12 03:49:56.373713 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-270171cc-ca55-4c78-9c19-219f9a2bf9b0 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:56.383164 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 53/110] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:55 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:56.386921 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-270171cc-ca55-4c78-9c19-219f9a2bf9b0 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.467244 Jul 12 03:49:56.387339 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 58/111] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:55 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:56.400358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e38c66ac-673a-4986-92a2-25d68f1c1778 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:56.401298 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e38c66ac-673a-4986-92a2-25d68f1c1778 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:56.402554 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-46a67147-da78-4af2-9824-d1033f891ee6 req-14915ae6-b581-441a-b2fa-e5663bc9a4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02a9be9-245a-4206-b88e-e7f7b9162ce3", "name": "network-vif-plugged", "status": "completed", "tag": "6845f790-c764-4fae-adef-13d8d80d7354"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:49:56.417359 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-46a67147-da78-4af2-9824-d1033f891ee6 req-14915ae6-b581-441a-b2fa-e5663bc9a4f3 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:56.417359 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-46a67147-da78-4af2-9824-d1033f891ee6 req-14915ae6-b581-441a-b2fa-e5663bc9a4f3 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:56.429180 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e38c66ac-673a-4986-92a2-25d68f1c1778 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:56.431140 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e38c66ac-673a-4986-92a2-25d68f1c1778 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:56.433492 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e38c66ac-673a-4986-92a2-25d68f1c1778 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:56.437648 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e38c66ac-673a-4986-92a2-25d68f1c1778 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:56.437820 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-46a67147-da78-4af2-9824-d1033f891ee6 req-14915ae6-b581-441a-b2fa-e5663bc9a4f3 service nova] Creating event network-vif-plugged:6845f790-c764-4fae-adef-13d8d80d7354 for instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 on hv-cinder-84773 Jul 12 03:49:56.438426 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-46a67147-da78-4af2-9824-d1033f891ee6 req-14915ae6-b581-441a-b2fa-e5663bc9a4f3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124435) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 03:49:56.439691 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-73f1c4fe-09a5-4cf5-af6b-bc9963764bed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:56.440625 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-73f1c4fe-09a5-4cf5-af6b-bc9963764bed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:56.441352 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-73f1c4fe-09a5-4cf5-af6b-bc9963764bed None None] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:56.441851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-73f1c4fe-09a5-4cf5-af6b-bc9963764bed None None] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:56.452560 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.compute.rpcapi [None req-73f1c4fe-09a5-4cf5-af6b-bc9963764bed None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 03:49:56.453755 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-73f1c4fe-09a5-4cf5-af6b-bc9963764bed None None] Releasing lock "compute-rpcapi-router" {{(pid=124435) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 03:49:56.471454 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-73f1c4fe-09a5-4cf5-af6b-bc9963764bed None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086624 Jul 12 03:49:56.472206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 54/112] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:49:56.479913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:49:56.802744 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e38c66ac-673a-4986-92a2-25d68f1c1778 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:56.812919 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e38c66ac-673a-4986-92a2-25d68f1c1778 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.424261 Jul 12 03:49:56.822035 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 59/113] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:56 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:57.392086 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5097425a-49cc-400f-a077-421214eb8190 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:57.392851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5097425a-49cc-400f-a077-421214eb8190 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:57.405212 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f8a46d26-0695-4fcf-b967-2e599a1ffb56 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:57.406276 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f8a46d26-0695-4fcf-b967-2e599a1ffb56 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:57.414514 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f8a46d26-0695-4fcf-b967-2e599a1ffb56 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:57.416354 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5097425a-49cc-400f-a077-421214eb8190 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:57.417137 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5097425a-49cc-400f-a077-421214eb8190 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:57.418054 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5097425a-49cc-400f-a077-421214eb8190 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:57.419139 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f8a46d26-0695-4fcf-b967-2e599a1ffb56 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:57.420413 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5097425a-49cc-400f-a077-421214eb8190 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:57.434109 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f8a46d26-0695-4fcf-b967-2e599a1ffb56 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:57.434626 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f8a46d26-0695-4fcf-b967-2e599a1ffb56 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:57.610813 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5097425a-49cc-400f-a077-421214eb8190 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:57.619174 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5097425a-49cc-400f-a077-421214eb8190 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:57.620098 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f8a46d26-0695-4fcf-b967-2e599a1ffb56 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:57.621081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5097425a-49cc-400f-a077-421214eb8190 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:57.622350 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5097425a-49cc-400f-a077-421214eb8190 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.235926 Jul 12 03:49:57.629698 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f8a46d26-0695-4fcf-b967-2e599a1ffb56 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.229083 Jul 12 03:49:57.630780 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 60/114] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:57 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:57.633021 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 55/115] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:57 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:57.830111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-23caf987-7471-43c8-b15f-ad24c9996238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:57.830903 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-23caf987-7471-43c8-b15f-ad24c9996238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:57.839818 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-23caf987-7471-43c8-b15f-ad24c9996238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:57.840410 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-23caf987-7471-43c8-b15f-ad24c9996238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:57.841454 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-23caf987-7471-43c8-b15f-ad24c9996238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:57.841955 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-23caf987-7471-43c8-b15f-ad24c9996238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:57.984314 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-23caf987-7471-43c8-b15f-ad24c9996238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:57.993088 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-23caf987-7471-43c8-b15f-ad24c9996238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.167313 Jul 12 03:49:57.993798 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 61/116] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:57 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:58.651485 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-acf89460-c7f4-4115-b5c1-f7a66c5a5aaf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:58.652383 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-3771279f-e10e-49ae-ab2f-0037451c2ae5 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:58.653009 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-acf89460-c7f4-4115-b5c1-f7a66c5a5aaf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:58.655008 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-3771279f-e10e-49ae-ab2f-0037451c2ae5 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:58.663090 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3771279f-e10e-49ae-ab2f-0037451c2ae5 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:58.663906 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3771279f-e10e-49ae-ab2f-0037451c2ae5 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:58.664922 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3771279f-e10e-49ae-ab2f-0037451c2ae5 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:58.665584 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3771279f-e10e-49ae-ab2f-0037451c2ae5 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:58.666605 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-acf89460-c7f4-4115-b5c1-f7a66c5a5aaf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:58.667066 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-acf89460-c7f4-4115-b5c1-f7a66c5a5aaf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:58.672328 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-acf89460-c7f4-4115-b5c1-f7a66c5a5aaf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:58.672898 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-acf89460-c7f4-4115-b5c1-f7a66c5a5aaf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:58.862107 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-acf89460-c7f4-4115-b5c1-f7a66c5a5aaf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:58.874743 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-acf89460-c7f4-4115-b5c1-f7a66c5a5aaf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:58.879646 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-acf89460-c7f4-4115-b5c1-f7a66c5a5aaf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:58.882249 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-acf89460-c7f4-4115-b5c1-f7a66c5a5aaf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.243599 Jul 12 03:49:58.884626 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 56/117] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:58 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:49:58.897621 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-3771279f-e10e-49ae-ab2f-0037451c2ae5 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:58.911811 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-3771279f-e10e-49ae-ab2f-0037451c2ae5 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.268749 Jul 12 03:49:58.912976 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 62/118] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:58 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:59.009783 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b588393e-fc29-4acf-af8e-c8b544d004d0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:59.010401 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b588393e-fc29-4acf-af8e-c8b544d004d0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:59.017330 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b588393e-fc29-4acf-af8e-c8b544d004d0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:59.017815 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b588393e-fc29-4acf-af8e-c8b544d004d0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:59.018595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b588393e-fc29-4acf-af8e-c8b544d004d0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:59.019542 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b588393e-fc29-4acf-af8e-c8b544d004d0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:59.191265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b588393e-fc29-4acf-af8e-c8b544d004d0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:49:59.201120 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b588393e-fc29-4acf-af8e-c8b544d004d0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.196072 Jul 12 03:49:59.201798 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 57/119] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:59 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:49:59.902564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9f1c0408-d184-477c-9af2-5b31559191a6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:59.903167 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-9f1c0408-d184-477c-9af2-5b31559191a6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:59.909411 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9f1c0408-d184-477c-9af2-5b31559191a6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:59.910087 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9f1c0408-d184-477c-9af2-5b31559191a6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:59.911030 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9f1c0408-d184-477c-9af2-5b31559191a6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:59.911533 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9f1c0408-d184-477c-9af2-5b31559191a6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:59.931021 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-85a85704-3e63-4488-8374-969e692e45f7 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:49:59.933536 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-85a85704-3e63-4488-8374-969e692e45f7 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:49:59.941957 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-85a85704-3e63-4488-8374-969e692e45f7 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:59.942794 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-85a85704-3e63-4488-8374-969e692e45f7 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:49:59.944112 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-85a85704-3e63-4488-8374-969e692e45f7 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:49:59.944769 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-85a85704-3e63-4488-8374-969e692e45f7 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:00.067926 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9f1c0408-d184-477c-9af2-5b31559191a6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:00.076827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9f1c0408-d184-477c-9af2-5b31559191a6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:00.078477 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9f1c0408-d184-477c-9af2-5b31559191a6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:00.079835 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9f1c0408-d184-477c-9af2-5b31559191a6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.181062 Jul 12 03:50:00.080567 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 63/120] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:49:59 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:00.126565 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-85a85704-3e63-4488-8374-969e692e45f7 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:00.134675 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-85a85704-3e63-4488-8374-969e692e45f7 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.209958 Jul 12 03:50:00.135574 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 58/121] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:49:59 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:50:00.218400 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c96592f2-4d7e-471e-b557-ddb35c9f1edd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:00.219211 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c96592f2-4d7e-471e-b557-ddb35c9f1edd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:00.225985 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c96592f2-4d7e-471e-b557-ddb35c9f1edd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:00.226815 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c96592f2-4d7e-471e-b557-ddb35c9f1edd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:00.227600 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c96592f2-4d7e-471e-b557-ddb35c9f1edd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:00.228061 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c96592f2-4d7e-471e-b557-ddb35c9f1edd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:00.440819 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c96592f2-4d7e-471e-b557-ddb35c9f1edd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:00.450244 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c96592f2-4d7e-471e-b557-ddb35c9f1edd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.235693 Jul 12 03:50:00.452306 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 64/122] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:00 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:01.102100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c28e5d10-302b-4535-865d-8269b7a25d96 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:01.102698 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c28e5d10-302b-4535-865d-8269b7a25d96 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:01.119037 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c28e5d10-302b-4535-865d-8269b7a25d96 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:01.120412 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c28e5d10-302b-4535-865d-8269b7a25d96 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:01.121327 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c28e5d10-302b-4535-865d-8269b7a25d96 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:01.129651 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c28e5d10-302b-4535-865d-8269b7a25d96 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:01.152912 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a512b68e-4a2a-4a53-94a1-ef9317e7ec78 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:01.153535 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a512b68e-4a2a-4a53-94a1-ef9317e7ec78 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:01.160170 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a512b68e-4a2a-4a53-94a1-ef9317e7ec78 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:01.160795 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a512b68e-4a2a-4a53-94a1-ef9317e7ec78 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:01.161703 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a512b68e-4a2a-4a53-94a1-ef9317e7ec78 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:01.162309 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a512b68e-4a2a-4a53-94a1-ef9317e7ec78 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:01.342723 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c28e5d10-302b-4535-865d-8269b7a25d96 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:01.352419 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c28e5d10-302b-4535-865d-8269b7a25d96 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:01.354256 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c28e5d10-302b-4535-865d-8269b7a25d96 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:01.355592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c28e5d10-302b-4535-865d-8269b7a25d96 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.260744 Jul 12 03:50:01.356770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 59/123] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:01 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:01.361690 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a512b68e-4a2a-4a53-94a1-ef9317e7ec78 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:01.373900 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a512b68e-4a2a-4a53-94a1-ef9317e7ec78 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.225637 Jul 12 03:50:01.374895 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 65/124] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:01 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:50:01.466704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b05c91e2-0800-49a7-a1ff-999aaa1125f2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:01.468270 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-3b2746c1-ae13-4c26-9820-75187bbf8e5c req-5a8ae636-9eab-4556-8da3-a8c89e9f2f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150b0be7-7300-4733-a0bc-76a06ec8bf4e", "name": "network-vif-plugged", "status": "completed", "tag": "d0f7e295-9d5e-45ea-b61d-7a13f716e4ae"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:50:01.468940 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b05c91e2-0800-49a7-a1ff-999aaa1125f2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:01.484382 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b05c91e2-0800-49a7-a1ff-999aaa1125f2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:01.485472 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b05c91e2-0800-49a7-a1ff-999aaa1125f2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:01.486508 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-3b2746c1-ae13-4c26-9820-75187bbf8e5c req-5a8ae636-9eab-4556-8da3-a8c89e9f2f3d service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:01.487477 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b05c91e2-0800-49a7-a1ff-999aaa1125f2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:01.488030 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-3b2746c1-ae13-4c26-9820-75187bbf8e5c req-5a8ae636-9eab-4556-8da3-a8c89e9f2f3d service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:01.488529 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b05c91e2-0800-49a7-a1ff-999aaa1125f2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:01.505668 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-3b2746c1-ae13-4c26-9820-75187bbf8e5c req-5a8ae636-9eab-4556-8da3-a8c89e9f2f3d service nova] Creating event network-vif-plugged:d0f7e295-9d5e-45ea-b61d-7a13f716e4ae for instance 150b0be7-7300-4733-a0bc-76a06ec8bf4e on hv-cinder-84773 Jul 12 03:50:01.534118 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-3b2746c1-ae13-4c26-9820-75187bbf8e5c req-5a8ae636-9eab-4556-8da3-a8c89e9f2f3d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075192 Jul 12 03:50:01.534791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 60/125] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:50:01.679894 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b05c91e2-0800-49a7-a1ff-999aaa1125f2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:01.688380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b05c91e2-0800-49a7-a1ff-999aaa1125f2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.225401 Jul 12 03:50:01.689666 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 66/126] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:01 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:02.384378 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a366099d-9c9e-4f72-92b8-08a9cd0b53a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:02.390607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-054f15c6-2af6-44e6-9a91-702823143ad8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:02.391222 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-054f15c6-2af6-44e6-9a91-702823143ad8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:02.395326 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a366099d-9c9e-4f72-92b8-08a9cd0b53a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:02.401705 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-054f15c6-2af6-44e6-9a91-702823143ad8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:02.402162 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-054f15c6-2af6-44e6-9a91-702823143ad8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:02.402936 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-054f15c6-2af6-44e6-9a91-702823143ad8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:02.403376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-054f15c6-2af6-44e6-9a91-702823143ad8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:02.407920 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a366099d-9c9e-4f72-92b8-08a9cd0b53a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:02.412300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a366099d-9c9e-4f72-92b8-08a9cd0b53a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:02.413339 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a366099d-9c9e-4f72-92b8-08a9cd0b53a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:02.414218 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a366099d-9c9e-4f72-92b8-08a9cd0b53a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:02.642503 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a366099d-9c9e-4f72-92b8-08a9cd0b53a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:02.652060 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-054f15c6-2af6-44e6-9a91-702823143ad8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:02.653252 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a366099d-9c9e-4f72-92b8-08a9cd0b53a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:02.661390 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-054f15c6-2af6-44e6-9a91-702823143ad8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.274760 Jul 12 03:50:02.661960 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 67/127] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:02 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:02.665270 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a366099d-9c9e-4f72-92b8-08a9cd0b53a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:02.666525 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a366099d-9c9e-4f72-92b8-08a9cd0b53a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.295159 Jul 12 03:50:02.667191 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 61/128] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:02 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:02.705612 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e088de13-8aac-43f6-80a2-63f21df7d92c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:02.706364 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e088de13-8aac-43f6-80a2-63f21df7d92c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:02.712671 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e088de13-8aac-43f6-80a2-63f21df7d92c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:02.712979 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e088de13-8aac-43f6-80a2-63f21df7d92c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:02.713743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e088de13-8aac-43f6-80a2-63f21df7d92c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:02.714178 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e088de13-8aac-43f6-80a2-63f21df7d92c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:02.843952 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e088de13-8aac-43f6-80a2-63f21df7d92c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:02.852392 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e088de13-8aac-43f6-80a2-63f21df7d92c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.150642 Jul 12 03:50:02.852989 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 68/129] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:02 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:03.679663 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a921ef1b-d7f6-4f85-83cb-03c8e3160b15 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:03.680943 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a921ef1b-d7f6-4f85-83cb-03c8e3160b15 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:03.688254 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-89834f1e-6682-414b-b4c2-d6ceae1f0d73 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:03.689217 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-89834f1e-6682-414b-b4c2-d6ceae1f0d73 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:03.695477 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a921ef1b-d7f6-4f85-83cb-03c8e3160b15 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:03.696141 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a921ef1b-d7f6-4f85-83cb-03c8e3160b15 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:03.696717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-89834f1e-6682-414b-b4c2-d6ceae1f0d73 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:03.697302 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-89834f1e-6682-414b-b4c2-d6ceae1f0d73 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:03.698523 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-89834f1e-6682-414b-b4c2-d6ceae1f0d73 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:03.698916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a921ef1b-d7f6-4f85-83cb-03c8e3160b15 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:03.699410 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-89834f1e-6682-414b-b4c2-d6ceae1f0d73 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:03.700237 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a921ef1b-d7f6-4f85-83cb-03c8e3160b15 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:03.856348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a921ef1b-d7f6-4f85-83cb-03c8e3160b15 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:03.867286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a921ef1b-d7f6-4f85-83cb-03c8e3160b15 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.190898 Jul 12 03:50:03.867927 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 62/130] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:03 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:03.873426 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-17dbf381-18a6-4e81-9cff-03cee408c192 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:03.874195 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-17dbf381-18a6-4e81-9cff-03cee408c192 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:03.880656 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-89834f1e-6682-414b-b4c2-d6ceae1f0d73 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:03.880810 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-17dbf381-18a6-4e81-9cff-03cee408c192 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:03.881230 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-17dbf381-18a6-4e81-9cff-03cee408c192 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:03.882186 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-17dbf381-18a6-4e81-9cff-03cee408c192 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:03.882622 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-17dbf381-18a6-4e81-9cff-03cee408c192 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:03.890496 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-89834f1e-6682-414b-b4c2-d6ceae1f0d73 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:03.892105 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-89834f1e-6682-414b-b4c2-d6ceae1f0d73 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:03.893623 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-89834f1e-6682-414b-b4c2-d6ceae1f0d73 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.212022 Jul 12 03:50:03.894490 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 69/131] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:03 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:04.066702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-17dbf381-18a6-4e81-9cff-03cee408c192 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:04.083365 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-17dbf381-18a6-4e81-9cff-03cee408c192 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.214157 Jul 12 03:50:04.088039 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 63/132] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:03 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:04.884152 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9b8c12d3-cdd8-4d21-9745-7c70e0e5ddf2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:04.884975 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-9b8c12d3-cdd8-4d21-9745-7c70e0e5ddf2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:04.891191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9b8c12d3-cdd8-4d21-9745-7c70e0e5ddf2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:04.891797 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9b8c12d3-cdd8-4d21-9745-7c70e0e5ddf2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:04.892590 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9b8c12d3-cdd8-4d21-9745-7c70e0e5ddf2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:04.893122 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9b8c12d3-cdd8-4d21-9745-7c70e0e5ddf2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:04.912533 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-69eb5efb-c9c0-4173-9a9e-b1d3a92cba0e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:04.913208 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-69eb5efb-c9c0-4173-9a9e-b1d3a92cba0e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:04.936171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-69eb5efb-c9c0-4173-9a9e-b1d3a92cba0e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:04.936739 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-69eb5efb-c9c0-4173-9a9e-b1d3a92cba0e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:04.937509 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-69eb5efb-c9c0-4173-9a9e-b1d3a92cba0e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:04.938114 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-69eb5efb-c9c0-4173-9a9e-b1d3a92cba0e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:05.061431 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9b8c12d3-cdd8-4d21-9745-7c70e0e5ddf2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:05.070226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9b8c12d3-cdd8-4d21-9745-7c70e0e5ddf2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.190064 Jul 12 03:50:05.071116 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 70/133] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:04 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:05.100237 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ce4cb6ae-64b5-4564-b465-01aaef36d0d4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:05.100926 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ce4cb6ae-64b5-4564-b465-01aaef36d0d4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:05.108302 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ce4cb6ae-64b5-4564-b465-01aaef36d0d4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:05.108760 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ce4cb6ae-64b5-4564-b465-01aaef36d0d4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:05.109566 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ce4cb6ae-64b5-4564-b465-01aaef36d0d4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:05.110003 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ce4cb6ae-64b5-4564-b465-01aaef36d0d4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:05.143983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-69eb5efb-c9c0-4173-9a9e-b1d3a92cba0e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:05.153390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-69eb5efb-c9c0-4173-9a9e-b1d3a92cba0e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:05.158061 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-69eb5efb-c9c0-4173-9a9e-b1d3a92cba0e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:05.159985 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-69eb5efb-c9c0-4173-9a9e-b1d3a92cba0e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.251951 Jul 12 03:50:05.160799 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 64/134] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:04 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:05.246353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ce4cb6ae-64b5-4564-b465-01aaef36d0d4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:05.254034 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ce4cb6ae-64b5-4564-b465-01aaef36d0d4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.157842 Jul 12 03:50:05.254603 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 71/135] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:05 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:06.087834 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5622073f-6d6e-46be-9cd2-be11bcde8dec tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:06.088528 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5622073f-6d6e-46be-9cd2-be11bcde8dec tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:06.093754 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=74 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:50:06.095927 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5622073f-6d6e-46be-9cd2-be11bcde8dec tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:06.096519 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5622073f-6d6e-46be-9cd2-be11bcde8dec tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:06.097347 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5622073f-6d6e-46be-9cd2-be11bcde8dec tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:06.097787 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5622073f-6d6e-46be-9cd2-be11bcde8dec tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:06.180271 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-881496c8-843f-43ea-ac7f-cc2e5faa16f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:06.181568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-881496c8-843f-43ea-ac7f-cc2e5faa16f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:06.188095 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-881496c8-843f-43ea-ac7f-cc2e5faa16f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:06.188780 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-881496c8-843f-43ea-ac7f-cc2e5faa16f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:06.189713 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-881496c8-843f-43ea-ac7f-cc2e5faa16f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:06.190411 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-881496c8-843f-43ea-ac7f-cc2e5faa16f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:06.246316 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5622073f-6d6e-46be-9cd2-be11bcde8dec tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:06.257366 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5622073f-6d6e-46be-9cd2-be11bcde8dec tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.174237 Jul 12 03:50:06.257977 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 65/136] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:06 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:06.270996 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6143d77f-3fc3-4e27-a9b4-fa5a92dc40a3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:06.271714 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6143d77f-3fc3-4e27-a9b4-fa5a92dc40a3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:06.278189 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6143d77f-3fc3-4e27-a9b4-fa5a92dc40a3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:06.278563 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6143d77f-3fc3-4e27-a9b4-fa5a92dc40a3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:06.279323 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6143d77f-3fc3-4e27-a9b4-fa5a92dc40a3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:06.279747 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6143d77f-3fc3-4e27-a9b4-fa5a92dc40a3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:06.352519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-881496c8-843f-43ea-ac7f-cc2e5faa16f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:06.362017 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-881496c8-843f-43ea-ac7f-cc2e5faa16f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:06.363531 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-881496c8-843f-43ea-ac7f-cc2e5faa16f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:06.364673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-881496c8-843f-43ea-ac7f-cc2e5faa16f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.190407 Jul 12 03:50:06.365226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 72/137] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:06 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:50:06.418684 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6143d77f-3fc3-4e27-a9b4-fa5a92dc40a3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:06.426445 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6143d77f-3fc3-4e27-a9b4-fa5a92dc40a3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.159878 Jul 12 03:50:06.427128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 66/138] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:06 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:07.274944 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2573e225-bdbf-4b73-8265-c172c3cdd841 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:07.275558 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2573e225-bdbf-4b73-8265-c172c3cdd841 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:07.281931 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2573e225-bdbf-4b73-8265-c172c3cdd841 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:07.282382 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2573e225-bdbf-4b73-8265-c172c3cdd841 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:07.283143 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2573e225-bdbf-4b73-8265-c172c3cdd841 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:07.283571 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2573e225-bdbf-4b73-8265-c172c3cdd841 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:07.382869 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-28a72d20-be47-4f68-9302-d3d24af40c99 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:07.383425 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-28a72d20-be47-4f68-9302-d3d24af40c99 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:07.385336 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:50:07.391029 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28a72d20-be47-4f68-9302-d3d24af40c99 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:07.391478 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28a72d20-be47-4f68-9302-d3d24af40c99 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:07.392273 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28a72d20-be47-4f68-9302-d3d24af40c99 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:07.392695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28a72d20-be47-4f68-9302-d3d24af40c99 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:07.418207 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-2573e225-bdbf-4b73-8265-c172c3cdd841 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:07.425884 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2573e225-bdbf-4b73-8265-c172c3cdd841 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.154793 Jul 12 03:50:07.426441 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 73/139] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:07 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:07.442566 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-aec19acb-da98-403e-9be6-06d1dd96ac22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:07.443167 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-aec19acb-da98-403e-9be6-06d1dd96ac22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:07.449494 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-aec19acb-da98-403e-9be6-06d1dd96ac22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:07.449933 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-aec19acb-da98-403e-9be6-06d1dd96ac22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:07.450685 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-aec19acb-da98-403e-9be6-06d1dd96ac22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:07.451145 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-aec19acb-da98-403e-9be6-06d1dd96ac22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:07.520932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-28a72d20-be47-4f68-9302-d3d24af40c99 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:07.528826 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-28a72d20-be47-4f68-9302-d3d24af40c99 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:07.530331 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-28a72d20-be47-4f68-9302-d3d24af40c99 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:07.531405 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-28a72d20-be47-4f68-9302-d3d24af40c99 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.152627 Jul 12 03:50:07.531964 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 67/140] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:07 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:07.576572 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-aec19acb-da98-403e-9be6-06d1dd96ac22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:07.584316 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-aec19acb-da98-403e-9be6-06d1dd96ac22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.145526 Jul 12 03:50:07.584889 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 74/141] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:07 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:08.446915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6cdc2bfa-65ec-4fbf-a4a0-d8294da459c3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:08.447878 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6cdc2bfa-65ec-4fbf-a4a0-d8294da459c3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:08.458325 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6cdc2bfa-65ec-4fbf-a4a0-d8294da459c3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:08.459072 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6cdc2bfa-65ec-4fbf-a4a0-d8294da459c3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:08.460384 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6cdc2bfa-65ec-4fbf-a4a0-d8294da459c3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:08.461105 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6cdc2bfa-65ec-4fbf-a4a0-d8294da459c3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:08.549361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d219f491-a67e-4fae-a8e9-f1140df59dad tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:08.551487 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d219f491-a67e-4fae-a8e9-f1140df59dad tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:08.558403 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d219f491-a67e-4fae-a8e9-f1140df59dad tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:08.559353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d219f491-a67e-4fae-a8e9-f1140df59dad tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:08.560353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d219f491-a67e-4fae-a8e9-f1140df59dad tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:08.560993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d219f491-a67e-4fae-a8e9-f1140df59dad tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:08.623116 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6cdc2bfa-65ec-4fbf-a4a0-d8294da459c3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:08.632219 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6cdc2bfa-65ec-4fbf-a4a0-d8294da459c3 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.191835 Jul 12 03:50:08.633359 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 68/142] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:08 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:08.638557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b129bcc2-6798-4716-b8c2-978334fb51f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:08.639162 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b129bcc2-6798-4716-b8c2-978334fb51f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:08.646914 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b129bcc2-6798-4716-b8c2-978334fb51f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:08.647438 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b129bcc2-6798-4716-b8c2-978334fb51f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:08.648221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b129bcc2-6798-4716-b8c2-978334fb51f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:08.648802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b129bcc2-6798-4716-b8c2-978334fb51f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:08.654700 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=100 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:50:08.708305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d219f491-a67e-4fae-a8e9-f1140df59dad tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:08.716895 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d219f491-a67e-4fae-a8e9-f1140df59dad tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:08.718834 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d219f491-a67e-4fae-a8e9-f1140df59dad tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:08.719525 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d219f491-a67e-4fae-a8e9-f1140df59dad tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.174105 Jul 12 03:50:08.720103 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 75/143] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:08 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:50:08.724770 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-43161daa-c1c0-4ce0-b12a-12d866daf49c req-5b1f2ab5-687a-4f24-9e23-6a064155032e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae771f5b-03de-46db-82fc-cd94d731405a", "name": "network-vif-plugged", "status": "completed", "tag": "28823cfb-b758-4345-b841-353bcf53f8b8"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:50:08.733803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-43161daa-c1c0-4ce0-b12a-12d866daf49c req-5b1f2ab5-687a-4f24-9e23-6a064155032e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:08.734383 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-43161daa-c1c0-4ce0-b12a-12d866daf49c req-5b1f2ab5-687a-4f24-9e23-6a064155032e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:08.739255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:50:08.749070 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-43161daa-c1c0-4ce0-b12a-12d866daf49c req-5b1f2ab5-687a-4f24-9e23-6a064155032e service nova] Creating event network-vif-plugged:28823cfb-b758-4345-b841-353bcf53f8b8 for instance ae771f5b-03de-46db-82fc-cd94d731405a on hv-cinder-84773 Jul 12 03:50:08.754358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-43161daa-c1c0-4ce0-b12a-12d866daf49c req-5b1f2ab5-687a-4f24-9e23-6a064155032e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033156 Jul 12 03:50:08.754966 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 76/144] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:50:08.785950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b129bcc2-6798-4716-b8c2-978334fb51f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:08.793668 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b129bcc2-6798-4716-b8c2-978334fb51f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1320 microversion: 2.1 time: 0.159031 Jul 12 03:50:08.794231 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 69/145] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:08 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:09.650368 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d1628e9b-ca81-4a7c-b393-a0f6ecb229dc tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:09.651065 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d1628e9b-ca81-4a7c-b393-a0f6ecb229dc tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:09.657723 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1628e9b-ca81-4a7c-b393-a0f6ecb229dc tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:09.658248 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1628e9b-ca81-4a7c-b393-a0f6ecb229dc tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:09.658960 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1628e9b-ca81-4a7c-b393-a0f6ecb229dc tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:09.659391 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1628e9b-ca81-4a7c-b393-a0f6ecb229dc tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:09.739433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d41e15d3-edc5-4b7a-a835-d51e0bb3d475 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:09.740059 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d41e15d3-edc5-4b7a-a835-d51e0bb3d475 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:09.746383 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d41e15d3-edc5-4b7a-a835-d51e0bb3d475 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:09.746803 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d41e15d3-edc5-4b7a-a835-d51e0bb3d475 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:09.747603 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d41e15d3-edc5-4b7a-a835-d51e0bb3d475 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:09.748143 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d41e15d3-edc5-4b7a-a835-d51e0bb3d475 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:09.792767 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d1628e9b-ca81-4a7c-b393-a0f6ecb229dc tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:09.800414 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d1628e9b-ca81-4a7c-b393-a0f6ecb229dc tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1314 microversion: 2.1 time: 0.154129 Jul 12 03:50:09.801005 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 77/146] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:09 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:09.809903 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-245d58c3-ce40-42f6-adfa-3e2668983636 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:09.810502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-245d58c3-ce40-42f6-adfa-3e2668983636 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:09.816366 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-245d58c3-ce40-42f6-adfa-3e2668983636 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:09.816812 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-245d58c3-ce40-42f6-adfa-3e2668983636 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:09.817583 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-245d58c3-ce40-42f6-adfa-3e2668983636 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:09.817998 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-245d58c3-ce40-42f6-adfa-3e2668983636 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:09.883104 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d41e15d3-edc5-4b7a-a835-d51e0bb3d475 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:09.892211 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d41e15d3-edc5-4b7a-a835-d51e0bb3d475 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:09.893716 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d41e15d3-edc5-4b7a-a835-d51e0bb3d475 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:09.895232 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d41e15d3-edc5-4b7a-a835-d51e0bb3d475 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.160563 Jul 12 03:50:09.895794 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 70/147] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:09 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:50:09.954038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-245d58c3-ce40-42f6-adfa-3e2668983636 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:09.961881 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-245d58c3-ce40-42f6-adfa-3e2668983636 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1513 microversion: 2.1 time: 0.155505 Jul 12 03:50:09.962887 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 78/148] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:09 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:50:09.978970 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-de617abd-b42e-49d4-975a-4e624fbcce2c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:50:09.980049 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-de617abd-b42e-49d4-975a-4e624fbcce2c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:09.986953 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-de617abd-b42e-49d4-975a-4e624fbcce2c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:09.987368 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-de617abd-b42e-49d4-975a-4e624fbcce2c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:09.988215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-de617abd-b42e-49d4-975a-4e624fbcce2c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:09.988646 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-de617abd-b42e-49d4-975a-4e624fbcce2c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:10.052951 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.objects.instance [None req-de617abd-b42e-49d4-975a-4e624fbcce2c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lazy-loading 'flavor' on Instance uuid 150b0be7-7300-4733-a0bc-76a06ec8bf4e {{(pid=124435) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:50:10.200725 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-de617abd-b42e-49d4-975a-4e624fbcce2c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "POST /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e/action" status: 200 len: 32 microversion: 2.1 time: 0.225561 Jul 12 03:50:10.201398 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 71/149] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 03:50:09 2022] POST /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 03:50:10.214745 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-efc61da5-32cc-44d2-add3-cbe5c5af24a0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:10.215481 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-efc61da5-32cc-44d2-add3-cbe5c5af24a0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:10.223435 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-efc61da5-32cc-44d2-add3-cbe5c5af24a0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:10.223968 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-efc61da5-32cc-44d2-add3-cbe5c5af24a0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:10.224932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-efc61da5-32cc-44d2-add3-cbe5c5af24a0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:10.225423 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-efc61da5-32cc-44d2-add3-cbe5c5af24a0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:10.370892 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-efc61da5-32cc-44d2-add3-cbe5c5af24a0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:10.387435 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-efc61da5-32cc-44d2-add3-cbe5c5af24a0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.179985 Jul 12 03:50:10.388085 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 79/150] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:10 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:10.818363 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-81dacc8e-98a4-438e-96fc-e5c4b287e6e8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:10.819225 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-81dacc8e-98a4-438e-96fc-e5c4b287e6e8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:10.828606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-81dacc8e-98a4-438e-96fc-e5c4b287e6e8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:10.829196 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-81dacc8e-98a4-438e-96fc-e5c4b287e6e8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:10.830322 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-81dacc8e-98a4-438e-96fc-e5c4b287e6e8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:10.830832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-81dacc8e-98a4-438e-96fc-e5c4b287e6e8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:10.913254 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e4fb0724-e836-40a9-99f0-a939f0f56f2c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:10.914508 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e4fb0724-e836-40a9-99f0-a939f0f56f2c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:10.920688 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e4fb0724-e836-40a9-99f0-a939f0f56f2c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:10.921135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e4fb0724-e836-40a9-99f0-a939f0f56f2c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:10.921961 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e4fb0724-e836-40a9-99f0-a939f0f56f2c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:10.922427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e4fb0724-e836-40a9-99f0-a939f0f56f2c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:10.975848 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-81dacc8e-98a4-438e-96fc-e5c4b287e6e8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:10.983966 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-81dacc8e-98a4-438e-96fc-e5c4b287e6e8 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1501 microversion: 2.1 time: 0.170278 Jul 12 03:50:10.985573 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 72/151] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:10 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:11.057835 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e4fb0724-e836-40a9-99f0-a939f0f56f2c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:11.065845 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e4fb0724-e836-40a9-99f0-a939f0f56f2c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:11.067381 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e4fb0724-e836-40a9-99f0-a939f0f56f2c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:11.068523 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e4fb0724-e836-40a9-99f0-a939f0f56f2c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.159621 Jul 12 03:50:11.069088 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 80/152] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:10 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:11.405637 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-55ea75d3-09cd-45fa-a005-4555e501013f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:11.409618 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-55ea75d3-09cd-45fa-a005-4555e501013f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:11.412433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-55ea75d3-09cd-45fa-a005-4555e501013f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:11.412885 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-55ea75d3-09cd-45fa-a005-4555e501013f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:11.413652 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-55ea75d3-09cd-45fa-a005-4555e501013f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:11.414087 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-55ea75d3-09cd-45fa-a005-4555e501013f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:11.545427 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-55ea75d3-09cd-45fa-a005-4555e501013f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:11.553569 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-55ea75d3-09cd-45fa-a005-4555e501013f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.152391 Jul 12 03:50:11.554267 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 73/153] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:11 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:12.090893 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-132798ac-f7ba-452e-b4ef-b9f808551ecb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:12.091894 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-132798ac-f7ba-452e-b4ef-b9f808551ecb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:12.100441 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-132798ac-f7ba-452e-b4ef-b9f808551ecb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:12.100883 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-132798ac-f7ba-452e-b4ef-b9f808551ecb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:12.101640 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-132798ac-f7ba-452e-b4ef-b9f808551ecb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:12.102066 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-132798ac-f7ba-452e-b4ef-b9f808551ecb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:12.243016 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-132798ac-f7ba-452e-b4ef-b9f808551ecb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:12.251155 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-132798ac-f7ba-452e-b4ef-b9f808551ecb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:12.252696 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-132798ac-f7ba-452e-b4ef-b9f808551ecb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:12.253847 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-132798ac-f7ba-452e-b4ef-b9f808551ecb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.169727 Jul 12 03:50:12.254411 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 81/154] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:12 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:12.571676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-efe6606c-1aa0-48d7-bb98-890d8b27fea9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:12.572308 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-efe6606c-1aa0-48d7-bb98-890d8b27fea9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:12.579211 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-efe6606c-1aa0-48d7-bb98-890d8b27fea9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:12.579664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-efe6606c-1aa0-48d7-bb98-890d8b27fea9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:12.580469 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-efe6606c-1aa0-48d7-bb98-890d8b27fea9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:12.580894 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-efe6606c-1aa0-48d7-bb98-890d8b27fea9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:12.723124 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-efe6606c-1aa0-48d7-bb98-890d8b27fea9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:12.730923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-efe6606c-1aa0-48d7-bb98-890d8b27fea9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.163557 Jul 12 03:50:12.731548 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 74/155] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:12 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:13.272660 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d643902b-1eda-4c55-a898-7c556306e203 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:13.273259 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d643902b-1eda-4c55-a898-7c556306e203 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:13.279731 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d643902b-1eda-4c55-a898-7c556306e203 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:13.280213 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d643902b-1eda-4c55-a898-7c556306e203 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:13.281014 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d643902b-1eda-4c55-a898-7c556306e203 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:13.281924 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d643902b-1eda-4c55-a898-7c556306e203 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:13.430447 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d643902b-1eda-4c55-a898-7c556306e203 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:13.438645 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d643902b-1eda-4c55-a898-7c556306e203 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:13.440195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d643902b-1eda-4c55-a898-7c556306e203 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:13.441266 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d643902b-1eda-4c55-a898-7c556306e203 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.173177 Jul 12 03:50:13.441823 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 82/156] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:13 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:13.748935 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-11ae39ef-5041-4a29-920e-2b9895137de3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:13.749573 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-11ae39ef-5041-4a29-920e-2b9895137de3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:13.757029 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11ae39ef-5041-4a29-920e-2b9895137de3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:13.757524 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11ae39ef-5041-4a29-920e-2b9895137de3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:13.758370 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11ae39ef-5041-4a29-920e-2b9895137de3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:13.758854 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11ae39ef-5041-4a29-920e-2b9895137de3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:13.898682 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-11ae39ef-5041-4a29-920e-2b9895137de3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:13.906360 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-11ae39ef-5041-4a29-920e-2b9895137de3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.161853 Jul 12 03:50:13.906958 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 75/157] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:13 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:14.461596 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5e168149-45b7-4e1a-b1c2-601d07b07b5b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:14.462200 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5e168149-45b7-4e1a-b1c2-601d07b07b5b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:14.464310 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=80 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:50:14.469908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5e168149-45b7-4e1a-b1c2-601d07b07b5b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:14.470346 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5e168149-45b7-4e1a-b1c2-601d07b07b5b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:14.471272 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5e168149-45b7-4e1a-b1c2-601d07b07b5b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:14.471822 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5e168149-45b7-4e1a-b1c2-601d07b07b5b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:14.600558 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5e168149-45b7-4e1a-b1c2-601d07b07b5b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:14.608599 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5e168149-45b7-4e1a-b1c2-601d07b07b5b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:14.610093 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5e168149-45b7-4e1a-b1c2-601d07b07b5b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:14.611191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5e168149-45b7-4e1a-b1c2-601d07b07b5b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.154958 Jul 12 03:50:14.611762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 83/158] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:14 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:14.922799 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-dcbf567b-0b3c-4716-93e5-317d83f7db29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:14.923405 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-dcbf567b-0b3c-4716-93e5-317d83f7db29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:14.930482 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dcbf567b-0b3c-4716-93e5-317d83f7db29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:14.930934 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dcbf567b-0b3c-4716-93e5-317d83f7db29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:14.931706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dcbf567b-0b3c-4716-93e5-317d83f7db29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:14.932258 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dcbf567b-0b3c-4716-93e5-317d83f7db29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:15.066988 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-dcbf567b-0b3c-4716-93e5-317d83f7db29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:15.075906 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-dcbf567b-0b3c-4716-93e5-317d83f7db29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.157121 Jul 12 03:50:15.076582 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 76/159] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:14 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:15.632937 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c8c85ad9-98d6-408d-9545-6bd6e2adbc7e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:15.633530 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c8c85ad9-98d6-408d-9545-6bd6e2adbc7e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:15.639690 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c8c85ad9-98d6-408d-9545-6bd6e2adbc7e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:15.640175 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c8c85ad9-98d6-408d-9545-6bd6e2adbc7e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:15.640938 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c8c85ad9-98d6-408d-9545-6bd6e2adbc7e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:15.641372 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c8c85ad9-98d6-408d-9545-6bd6e2adbc7e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:15.768673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c8c85ad9-98d6-408d-9545-6bd6e2adbc7e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:15.777538 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c8c85ad9-98d6-408d-9545-6bd6e2adbc7e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:15.779032 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c8c85ad9-98d6-408d-9545-6bd6e2adbc7e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:15.780153 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c8c85ad9-98d6-408d-9545-6bd6e2adbc7e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.151828 Jul 12 03:50:15.780705 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 84/160] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:15 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:16.093481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d67d30a2-9ce9-4c03-8016-c5c6cbe667f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:16.094017 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d67d30a2-9ce9-4c03-8016-c5c6cbe667f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:16.101300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d67d30a2-9ce9-4c03-8016-c5c6cbe667f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:16.101744 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d67d30a2-9ce9-4c03-8016-c5c6cbe667f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:16.102503 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d67d30a2-9ce9-4c03-8016-c5c6cbe667f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:16.102965 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d67d30a2-9ce9-4c03-8016-c5c6cbe667f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:16.295721 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d67d30a2-9ce9-4c03-8016-c5c6cbe667f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:16.304873 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d67d30a2-9ce9-4c03-8016-c5c6cbe667f1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.215338 Jul 12 03:50:16.305393 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 77/161] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:16 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:16.797875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-79397e40-246c-4db5-b929-fec94ec222e5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:16.798466 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-79397e40-246c-4db5-b929-fec94ec222e5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:16.804880 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-79397e40-246c-4db5-b929-fec94ec222e5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:16.805328 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-79397e40-246c-4db5-b929-fec94ec222e5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:16.806088 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-79397e40-246c-4db5-b929-fec94ec222e5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:16.806519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-79397e40-246c-4db5-b929-fec94ec222e5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:17.061959 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-79397e40-246c-4db5-b929-fec94ec222e5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:17.075427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-79397e40-246c-4db5-b929-fec94ec222e5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:17.077774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-79397e40-246c-4db5-b929-fec94ec222e5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:17.078894 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-79397e40-246c-4db5-b929-fec94ec222e5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1407 microversion: 2.20 time: 0.284971 Jul 12 03:50:17.089197 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 85/162] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:16 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:17.326648 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-22c62bc8-6971-4c42-aff3-541b59045aeb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:17.328381 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-22c62bc8-6971-4c42-aff3-541b59045aeb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:17.336495 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-22c62bc8-6971-4c42-aff3-541b59045aeb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:17.336918 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-22c62bc8-6971-4c42-aff3-541b59045aeb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:17.337713 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-22c62bc8-6971-4c42-aff3-541b59045aeb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:17.338309 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-22c62bc8-6971-4c42-aff3-541b59045aeb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:17.540918 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-22c62bc8-6971-4c42-aff3-541b59045aeb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:17.551416 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-22c62bc8-6971-4c42-aff3-541b59045aeb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.232438 Jul 12 03:50:17.552915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 78/163] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:17 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:17.667551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2084afc4-58a5-469c-9b73-e303c67eb388 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ece2e66-23fb-4a96-a8ba-523f7eac2740"}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:50:17.670076 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2084afc4-58a5-469c-9b73-e303c67eb388 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:17.697927 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2084afc4-58a5-469c-9b73-e303c67eb388 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:17.698442 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2084afc4-58a5-469c-9b73-e303c67eb388 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:17.699348 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2084afc4-58a5-469c-9b73-e303c67eb388 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:17.699793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2084afc4-58a5-469c-9b73-e303c67eb388 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:18.097336 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-81e6dca9-37d2-4287-b2e3-d53b30397902 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:18.098051 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-81e6dca9-37d2-4287-b2e3-d53b30397902 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:18.104354 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-81e6dca9-37d2-4287-b2e3-d53b30397902 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:18.104828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-81e6dca9-37d2-4287-b2e3-d53b30397902 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:18.105591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-81e6dca9-37d2-4287-b2e3-d53b30397902 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:18.106017 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-81e6dca9-37d2-4287-b2e3-d53b30397902 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:18.347368 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-81e6dca9-37d2-4287-b2e3-d53b30397902 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:18.373815 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-81e6dca9-37d2-4287-b2e3-d53b30397902 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:18.379034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-81e6dca9-37d2-4287-b2e3-d53b30397902 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:18.381090 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-81e6dca9-37d2-4287-b2e3-d53b30397902 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1599 microversion: 2.20 time: 0.287387 Jul 12 03:50:18.381707 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 79/164] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:50:18 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1599 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:50:18.404984 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1f801852-97ae-4b02-aa68-a653aeb9ef3b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:18.405475 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1f801852-97ae-4b02-aa68-a653aeb9ef3b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:18.417692 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1f801852-97ae-4b02-aa68-a653aeb9ef3b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:18.418198 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1f801852-97ae-4b02-aa68-a653aeb9ef3b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:18.419057 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1f801852-97ae-4b02-aa68-a653aeb9ef3b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:18.419683 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1f801852-97ae-4b02-aa68-a653aeb9ef3b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:18.545347 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1f801852-97ae-4b02-aa68-a653aeb9ef3b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.148596 Jul 12 03:50:18.552079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 80/165] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Jul 12 03:50:18 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:50:18.560284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2084afc4-58a5-469c-9b73-e303c67eb388 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "POST /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.896405 Jul 12 03:50:18.561988 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 86/166] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 03:50:17 2022] POST /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3/os-volume_attachments => generated 194 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:50:18.575985 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-630cf345-bf80-41c1-9514-3940bc5e16b5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:18.576635 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-630cf345-bf80-41c1-9514-3940bc5e16b5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:18.586907 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-630cf345-bf80-41c1-9514-3940bc5e16b5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:18.587708 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-630cf345-bf80-41c1-9514-3940bc5e16b5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:18.589125 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-630cf345-bf80-41c1-9514-3940bc5e16b5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:18.590122 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-630cf345-bf80-41c1-9514-3940bc5e16b5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:18.832979 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-630cf345-bf80-41c1-9514-3940bc5e16b5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:18.842943 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-630cf345-bf80-41c1-9514-3940bc5e16b5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.277474 Jul 12 03:50:18.843846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 81/167] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:18 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:19.861807 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c7aa5fb8-ad95-4468-94e2-7f7396d951d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:19.862475 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c7aa5fb8-ad95-4468-94e2-7f7396d951d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:19.869514 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c7aa5fb8-ad95-4468-94e2-7f7396d951d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:19.869957 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c7aa5fb8-ad95-4468-94e2-7f7396d951d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:19.870711 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c7aa5fb8-ad95-4468-94e2-7f7396d951d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:19.871140 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c7aa5fb8-ad95-4468-94e2-7f7396d951d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:20.084125 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c7aa5fb8-ad95-4468-94e2-7f7396d951d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:20.093682 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c7aa5fb8-ad95-4468-94e2-7f7396d951d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.236183 Jul 12 03:50:20.109478 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 87/168] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:19 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:20.150085 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-4375962a-4f0f-43f0-afcb-e8feb1c3f485 req-838a4d50-b32a-4ff3-86a4-f1bc47f62c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae771f5b-03de-46db-82fc-cd94d731405a", "tag": "28823cfb-b758-4345-b841-353bcf53f8b8"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:50:20.165292 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-4375962a-4f0f-43f0-afcb-e8feb1c3f485 req-838a4d50-b32a-4ff3-86a4-f1bc47f62c3d service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:20.165731 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-4375962a-4f0f-43f0-afcb-e8feb1c3f485 req-838a4d50-b32a-4ff3-86a4-f1bc47f62c3d service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:20.181238 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-4375962a-4f0f-43f0-afcb-e8feb1c3f485 req-838a4d50-b32a-4ff3-86a4-f1bc47f62c3d service nova] Creating event network-changed:28823cfb-b758-4345-b841-353bcf53f8b8 for instance ae771f5b-03de-46db-82fc-cd94d731405a on hv-cinder-84773 Jul 12 03:50:20.187974 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-4375962a-4f0f-43f0-afcb-e8feb1c3f485 req-838a4d50-b32a-4ff3-86a4-f1bc47f62c3d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041740 Jul 12 03:50:20.189040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 82/169] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:50:21.113184 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0db6e3c8-3467-4054-a50f-e203d681629a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:21.113888 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0db6e3c8-3467-4054-a50f-e203d681629a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:21.121574 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0db6e3c8-3467-4054-a50f-e203d681629a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:21.122016 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0db6e3c8-3467-4054-a50f-e203d681629a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:21.122766 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0db6e3c8-3467-4054-a50f-e203d681629a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:21.123195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0db6e3c8-3467-4054-a50f-e203d681629a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:21.273321 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0db6e3c8-3467-4054-a50f-e203d681629a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:21.281159 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0db6e3c8-3467-4054-a50f-e203d681629a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.171968 Jul 12 03:50:21.281739 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 88/170] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:21 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:22.303945 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d49b7d85-8204-4ad9-adad-f43dbe9d779e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:22.306066 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d49b7d85-8204-4ad9-adad-f43dbe9d779e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:22.317014 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d49b7d85-8204-4ad9-adad-f43dbe9d779e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:22.317816 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d49b7d85-8204-4ad9-adad-f43dbe9d779e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:22.318586 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d49b7d85-8204-4ad9-adad-f43dbe9d779e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:22.319016 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d49b7d85-8204-4ad9-adad-f43dbe9d779e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:22.448767 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d49b7d85-8204-4ad9-adad-f43dbe9d779e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:22.456400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d49b7d85-8204-4ad9-adad-f43dbe9d779e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.160056 Jul 12 03:50:22.456966 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 83/171] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:22 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:23.474122 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c300dd19-a9a3-4dad-aabc-152c3fe6fa5e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:23.474841 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c300dd19-a9a3-4dad-aabc-152c3fe6fa5e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:23.481670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c300dd19-a9a3-4dad-aabc-152c3fe6fa5e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:23.482199 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c300dd19-a9a3-4dad-aabc-152c3fe6fa5e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:23.483045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c300dd19-a9a3-4dad-aabc-152c3fe6fa5e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:23.483533 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c300dd19-a9a3-4dad-aabc-152c3fe6fa5e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:23.618567 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c300dd19-a9a3-4dad-aabc-152c3fe6fa5e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:23.626758 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c300dd19-a9a3-4dad-aabc-152c3fe6fa5e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.157407 Jul 12 03:50:23.627399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 89/172] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:23 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:50:24.644148 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1536e2a8-e496-4c38-9828-faa2861ba597 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:24.644749 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1536e2a8-e496-4c38-9828-faa2861ba597 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:24.651443 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1536e2a8-e496-4c38-9828-faa2861ba597 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:24.651892 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1536e2a8-e496-4c38-9828-faa2861ba597 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:24.652869 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1536e2a8-e496-4c38-9828-faa2861ba597 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:24.653301 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1536e2a8-e496-4c38-9828-faa2861ba597 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:24.845595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1536e2a8-e496-4c38-9828-faa2861ba597 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:24.849641 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:50:24.854734 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1536e2a8-e496-4c38-9828-faa2861ba597 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.214774 Jul 12 03:50:24.855319 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 84/173] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:24 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:25.872775 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a380952a-8944-466c-ad64-ecff0f052238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:25.873733 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a380952a-8944-466c-ad64-ecff0f052238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:25.881056 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a380952a-8944-466c-ad64-ecff0f052238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:25.881509 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a380952a-8944-466c-ad64-ecff0f052238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:25.882276 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a380952a-8944-466c-ad64-ecff0f052238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:25.882711 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a380952a-8944-466c-ad64-ecff0f052238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:26.014952 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a380952a-8944-466c-ad64-ecff0f052238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:26.023156 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a380952a-8944-466c-ad64-ecff0f052238 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.155043 Jul 12 03:50:26.023718 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 90/174] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:25 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:27.040434 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f236fcec-a154-42c1-80f8-ce012c8b7ccd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:27.041051 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f236fcec-a154-42c1-80f8-ce012c8b7ccd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:27.048455 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f236fcec-a154-42c1-80f8-ce012c8b7ccd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:27.048904 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f236fcec-a154-42c1-80f8-ce012c8b7ccd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:27.049665 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f236fcec-a154-42c1-80f8-ce012c8b7ccd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:27.050095 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f236fcec-a154-42c1-80f8-ce012c8b7ccd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:27.187781 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f236fcec-a154-42c1-80f8-ce012c8b7ccd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:27.195686 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f236fcec-a154-42c1-80f8-ce012c8b7ccd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.159461 Jul 12 03:50:27.196635 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 85/175] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:27 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:28.216825 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5608cce0-2cd0-4133-a2ac-7b3ca37ff0b1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:28.217631 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5608cce0-2cd0-4133-a2ac-7b3ca37ff0b1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:28.226867 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5608cce0-2cd0-4133-a2ac-7b3ca37ff0b1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:28.227312 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5608cce0-2cd0-4133-a2ac-7b3ca37ff0b1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:28.228107 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5608cce0-2cd0-4133-a2ac-7b3ca37ff0b1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:28.228539 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5608cce0-2cd0-4133-a2ac-7b3ca37ff0b1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:28.367437 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5608cce0-2cd0-4133-a2ac-7b3ca37ff0b1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:28.374962 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5608cce0-2cd0-4133-a2ac-7b3ca37ff0b1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.164794 Jul 12 03:50:28.375520 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 91/176] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:28 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:29.391035 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0ad47af1-d685-4cb7-91b5-84f4412a6b00 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:29.391677 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0ad47af1-d685-4cb7-91b5-84f4412a6b00 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:29.398365 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0ad47af1-d685-4cb7-91b5-84f4412a6b00 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:29.398850 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0ad47af1-d685-4cb7-91b5-84f4412a6b00 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:29.399610 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0ad47af1-d685-4cb7-91b5-84f4412a6b00 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:29.400044 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0ad47af1-d685-4cb7-91b5-84f4412a6b00 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:29.527456 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0ad47af1-d685-4cb7-91b5-84f4412a6b00 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:29.538376 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0ad47af1-d685-4cb7-91b5-84f4412a6b00 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.150877 Jul 12 03:50:29.539218 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 86/177] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:29 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:30.560928 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-be56a047-1f2a-4983-b8da-923d33c2330c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:30.561826 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-be56a047-1f2a-4983-b8da-923d33c2330c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:30.570310 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-be56a047-1f2a-4983-b8da-923d33c2330c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:30.570716 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-be56a047-1f2a-4983-b8da-923d33c2330c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:30.571484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-be56a047-1f2a-4983-b8da-923d33c2330c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:30.571950 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-be56a047-1f2a-4983-b8da-923d33c2330c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:30.576184 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:50:30.716287 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-be56a047-1f2a-4983-b8da-923d33c2330c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:30.726317 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-be56a047-1f2a-4983-b8da-923d33c2330c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.169984 Jul 12 03:50:30.726895 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 92/178] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:30 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:31.743608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-464924c5-33f2-4082-a26e-6a081dae4f42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:31.744182 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-464924c5-33f2-4082-a26e-6a081dae4f42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:31.750558 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-464924c5-33f2-4082-a26e-6a081dae4f42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:31.751122 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-464924c5-33f2-4082-a26e-6a081dae4f42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:31.751929 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-464924c5-33f2-4082-a26e-6a081dae4f42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:31.752395 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-464924c5-33f2-4082-a26e-6a081dae4f42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:31.898220 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-464924c5-33f2-4082-a26e-6a081dae4f42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:31.906388 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-464924c5-33f2-4082-a26e-6a081dae4f42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.166892 Jul 12 03:50:31.906959 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 87/179] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:31 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:32.927710 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5030455a-ba98-4cf5-8acc-1a0edf198339 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:32.928351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5030455a-ba98-4cf5-8acc-1a0edf198339 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:32.935243 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5030455a-ba98-4cf5-8acc-1a0edf198339 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:32.935690 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5030455a-ba98-4cf5-8acc-1a0edf198339 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:32.936529 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5030455a-ba98-4cf5-8acc-1a0edf198339 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:32.936958 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5030455a-ba98-4cf5-8acc-1a0edf198339 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:33.070693 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5030455a-ba98-4cf5-8acc-1a0edf198339 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:33.078357 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5030455a-ba98-4cf5-8acc-1a0edf198339 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.154547 Jul 12 03:50:33.078931 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 93/180] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:32 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:34.095703 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-22ae1103-c42d-4615-9878-bdb201175e68 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:34.096274 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-22ae1103-c42d-4615-9878-bdb201175e68 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:34.103304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-22ae1103-c42d-4615-9878-bdb201175e68 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:34.103757 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-22ae1103-c42d-4615-9878-bdb201175e68 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:34.104570 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-22ae1103-c42d-4615-9878-bdb201175e68 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:34.105009 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-22ae1103-c42d-4615-9878-bdb201175e68 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:34.245200 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-22ae1103-c42d-4615-9878-bdb201175e68 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:34.253193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-22ae1103-c42d-4615-9878-bdb201175e68 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.161401 Jul 12 03:50:34.253785 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 88/181] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:34 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:35.274745 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-488941f7-7705-496c-864d-39a29c570211 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:35.275658 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-488941f7-7705-496c-864d-39a29c570211 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:35.286665 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-488941f7-7705-496c-864d-39a29c570211 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:35.287415 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-488941f7-7705-496c-864d-39a29c570211 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:35.288722 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-488941f7-7705-496c-864d-39a29c570211 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:35.289473 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-488941f7-7705-496c-864d-39a29c570211 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:35.435453 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-488941f7-7705-496c-864d-39a29c570211 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:35.446268 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-488941f7-7705-496c-864d-39a29c570211 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.178582 Jul 12 03:50:35.446878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 94/182] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:35 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:36.466803 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7c871f18-d040-4d23-91fe-ef184acff309 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:36.467795 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7c871f18-d040-4d23-91fe-ef184acff309 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:36.470772 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=48 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:50:36.479684 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c871f18-d040-4d23-91fe-ef184acff309 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:36.480446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c871f18-d040-4d23-91fe-ef184acff309 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:36.481694 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c871f18-d040-4d23-91fe-ef184acff309 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:36.482407 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c871f18-d040-4d23-91fe-ef184acff309 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:36.622518 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-7c871f18-d040-4d23-91fe-ef184acff309 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:36.630532 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7c871f18-d040-4d23-91fe-ef184acff309 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.170359 Jul 12 03:50:36.631106 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 89/183] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:36 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:37.651827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-85981101-b39e-4d43-b077-fda13d8df79e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:37.653012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-85981101-b39e-4d43-b077-fda13d8df79e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:37.665217 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-85981101-b39e-4d43-b077-fda13d8df79e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:37.665788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-85981101-b39e-4d43-b077-fda13d8df79e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:37.666684 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-85981101-b39e-4d43-b077-fda13d8df79e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:37.667128 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-85981101-b39e-4d43-b077-fda13d8df79e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:37.802065 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-85981101-b39e-4d43-b077-fda13d8df79e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:37.810138 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-85981101-b39e-4d43-b077-fda13d8df79e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.164923 Jul 12 03:50:37.810721 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 95/184] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:37 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:38.830041 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-90918355-2642-429e-a53f-541d534c4507 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:38.830948 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-90918355-2642-429e-a53f-541d534c4507 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:38.839105 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-90918355-2642-429e-a53f-541d534c4507 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:38.839836 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-90918355-2642-429e-a53f-541d534c4507 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:38.840321 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-90918355-2642-429e-a53f-541d534c4507 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:38.840748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-90918355-2642-429e-a53f-541d534c4507 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:38.985663 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-90918355-2642-429e-a53f-541d534c4507 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:38.993603 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-90918355-2642-429e-a53f-541d534c4507 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.170212 Jul 12 03:50:38.994205 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 90/185] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:38 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:38.995488 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8e96848a-2030-4b5c-be68-004d94752db6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:38.995990 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8e96848a-2030-4b5c-be68-004d94752db6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:39.003081 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8e96848a-2030-4b5c-be68-004d94752db6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:39.003529 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8e96848a-2030-4b5c-be68-004d94752db6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:39.004348 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8e96848a-2030-4b5c-be68-004d94752db6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:39.004784 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8e96848a-2030-4b5c-be68-004d94752db6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:39.030223 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8e96848a-2030-4b5c-be68-004d94752db6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Going to try to terminate instance {{(pid=124434) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:50:39.124884 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8e96848a-2030-4b5c-be68-004d94752db6 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 204 len: 0 microversion: 2.1 time: 0.133600 Jul 12 03:50:39.126150 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 96/186] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:50:38 2022] DELETE /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:50:39.133827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-dd3a3cd7-56d8-4ae3-832a-4f250aba6045 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:39.134467 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-dd3a3cd7-56d8-4ae3-832a-4f250aba6045 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:39.140647 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dd3a3cd7-56d8-4ae3-832a-4f250aba6045 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:39.141093 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dd3a3cd7-56d8-4ae3-832a-4f250aba6045 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:39.141857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dd3a3cd7-56d8-4ae3-832a-4f250aba6045 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:39.142285 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dd3a3cd7-56d8-4ae3-832a-4f250aba6045 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:39.275326 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-dd3a3cd7-56d8-4ae3-832a-4f250aba6045 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:39.283660 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-dd3a3cd7-56d8-4ae3-832a-4f250aba6045 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1553 microversion: 2.1 time: 0.153867 Jul 12 03:50:39.284303 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 91/187] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:39 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:40.010629 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-34458786-c53a-4831-a73d-2ad8805bdf03 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:40.011316 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-34458786-c53a-4831-a73d-2ad8805bdf03 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:40.019600 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-34458786-c53a-4831-a73d-2ad8805bdf03 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:40.020145 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-34458786-c53a-4831-a73d-2ad8805bdf03 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:40.020927 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-34458786-c53a-4831-a73d-2ad8805bdf03 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:40.021363 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-34458786-c53a-4831-a73d-2ad8805bdf03 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:40.157829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-34458786-c53a-4831-a73d-2ad8805bdf03 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:40.165610 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-34458786-c53a-4831-a73d-2ad8805bdf03 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.159532 Jul 12 03:50:40.166181 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 97/188] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:40 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:40.300839 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-69eeca9c-895d-48fd-b627-2c49fbaa2b89 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:40.301668 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-69eeca9c-895d-48fd-b627-2c49fbaa2b89 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:40.308579 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-69eeca9c-895d-48fd-b627-2c49fbaa2b89 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:40.309196 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-69eeca9c-895d-48fd-b627-2c49fbaa2b89 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:40.310205 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-69eeca9c-895d-48fd-b627-2c49fbaa2b89 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:40.310682 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-69eeca9c-895d-48fd-b627-2c49fbaa2b89 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:40.456664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-69eeca9c-895d-48fd-b627-2c49fbaa2b89 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:40.470282 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-69eeca9c-895d-48fd-b627-2c49fbaa2b89 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1553 microversion: 2.1 time: 0.173116 Jul 12 03:50:40.471076 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 92/189] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:40 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:41.184884 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-926d1f41-c6ab-4e81-aaed-33b90172b931 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:41.185513 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-926d1f41-c6ab-4e81-aaed-33b90172b931 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:41.192785 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-926d1f41-c6ab-4e81-aaed-33b90172b931 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:41.193242 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-926d1f41-c6ab-4e81-aaed-33b90172b931 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:41.194081 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-926d1f41-c6ab-4e81-aaed-33b90172b931 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:41.194449 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-926d1f41-c6ab-4e81-aaed-33b90172b931 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:41.340328 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-926d1f41-c6ab-4e81-aaed-33b90172b931 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:41.347920 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-926d1f41-c6ab-4e81-aaed-33b90172b931 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.167896 Jul 12 03:50:41.348536 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 98/190] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:41 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:41.487535 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-21cd7cf8-2011-4888-bf89-130b5b5e03bf tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:41.488216 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-21cd7cf8-2011-4888-bf89-130b5b5e03bf tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:41.495047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-21cd7cf8-2011-4888-bf89-130b5b5e03bf tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:41.495468 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-21cd7cf8-2011-4888-bf89-130b5b5e03bf tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:41.496511 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-21cd7cf8-2011-4888-bf89-130b5b5e03bf tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:41.497205 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-21cd7cf8-2011-4888-bf89-130b5b5e03bf tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:41.636987 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-21cd7cf8-2011-4888-bf89-130b5b5e03bf tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:41.648576 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-21cd7cf8-2011-4888-bf89-130b5b5e03bf tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1553 microversion: 2.1 time: 0.165019 Jul 12 03:50:41.649188 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 93/191] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:41 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:42.365071 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5c8e2f45-3463-42eb-92b8-0d9cdc995e07 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:42.365818 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5c8e2f45-3463-42eb-92b8-0d9cdc995e07 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:42.375390 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5c8e2f45-3463-42eb-92b8-0d9cdc995e07 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:42.376397 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5c8e2f45-3463-42eb-92b8-0d9cdc995e07 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:42.377549 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5c8e2f45-3463-42eb-92b8-0d9cdc995e07 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:42.378339 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5c8e2f45-3463-42eb-92b8-0d9cdc995e07 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:42.539225 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5c8e2f45-3463-42eb-92b8-0d9cdc995e07 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:42.553112 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5c8e2f45-3463-42eb-92b8-0d9cdc995e07 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.191645 Jul 12 03:50:42.565488 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 99/192] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:42 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:42.666258 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-177cee3b-03de-4569-9853-1bf15f7bb9f2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:42.666882 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-177cee3b-03de-4569-9853-1bf15f7bb9f2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:42.673496 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-177cee3b-03de-4569-9853-1bf15f7bb9f2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:42.673950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-177cee3b-03de-4569-9853-1bf15f7bb9f2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:42.674727 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-177cee3b-03de-4569-9853-1bf15f7bb9f2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:42.675162 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-177cee3b-03de-4569-9853-1bf15f7bb9f2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:43.016657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-177cee3b-03de-4569-9853-1bf15f7bb9f2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:43.026024 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-177cee3b-03de-4569-9853-1bf15f7bb9f2 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1553 microversion: 2.1 time: 0.363567 Jul 12 03:50:43.026828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 94/193] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:42 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1553 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:43.259391 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-d6b5d819-c45c-43c1-894c-851553f1ac01 req-9b3d93f9-e352-4634-82fe-8e95fa40a375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02a9be9-245a-4206-b88e-e7f7b9162ce3", "name": "network-vif-deleted", "tag": "6845f790-c764-4fae-adef-13d8d80d7354"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:50:43.275587 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-d6b5d819-c45c-43c1-894c-851553f1ac01 req-9b3d93f9-e352-4634-82fe-8e95fa40a375 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:43.276546 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-d6b5d819-c45c-43c1-894c-851553f1ac01 req-9b3d93f9-e352-4634-82fe-8e95fa40a375 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:43.290297 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-d6b5d819-c45c-43c1-894c-851553f1ac01 req-9b3d93f9-e352-4634-82fe-8e95fa40a375 service nova] Creating event network-vif-deleted:6845f790-c764-4fae-adef-13d8d80d7354 for instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 on hv-cinder-84773 Jul 12 03:50:43.298422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-d6b5d819-c45c-43c1-894c-851553f1ac01 req-9b3d93f9-e352-4634-82fe-8e95fa40a375 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045203 Jul 12 03:50:43.299093 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 100/194] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:50:43.570286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9fe6626d-fe63-4fd9-a247-0470d94f2381 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:43.570895 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9fe6626d-fe63-4fd9-a247-0470d94f2381 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:43.577759 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9fe6626d-fe63-4fd9-a247-0470d94f2381 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:43.578208 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9fe6626d-fe63-4fd9-a247-0470d94f2381 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:43.578979 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9fe6626d-fe63-4fd9-a247-0470d94f2381 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:43.579423 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9fe6626d-fe63-4fd9-a247-0470d94f2381 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:43.716937 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9fe6626d-fe63-4fd9-a247-0470d94f2381 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:43.724516 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9fe6626d-fe63-4fd9-a247-0470d94f2381 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.158151 Jul 12 03:50:43.725108 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 95/195] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:43 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:44.044873 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-eead8aa0-4585-4cf6-9a61-31bfe6a9119b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:44.045589 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-eead8aa0-4585-4cf6-9a61-31bfe6a9119b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:44.052187 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-eead8aa0-4585-4cf6-9a61-31bfe6a9119b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:44.052632 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-eead8aa0-4585-4cf6-9a61-31bfe6a9119b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:44.053405 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-eead8aa0-4585-4cf6-9a61-31bfe6a9119b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:44.053839 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-eead8aa0-4585-4cf6-9a61-31bfe6a9119b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:44.161385 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-eead8aa0-4585-4cf6-9a61-31bfe6a9119b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ea64f67f264b20a7c556c625a64f80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b640d5f6734a6b95b46a6f9dd695ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:44.170305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-eead8aa0-4585-4cf6-9a61-31bfe6a9119b tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 200 len: 1345 microversion: 2.1 time: 0.130156 Jul 12 03:50:44.171024 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 101/196] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:44 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 1345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:44.745411 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5a52752b-b709-41a7-beda-1dbee8876088 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:44.746239 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5a52752b-b709-41a7-beda-1dbee8876088 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:44.753946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5a52752b-b709-41a7-beda-1dbee8876088 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:44.754521 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5a52752b-b709-41a7-beda-1dbee8876088 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:44.755399 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5a52752b-b709-41a7-beda-1dbee8876088 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:44.755955 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5a52752b-b709-41a7-beda-1dbee8876088 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:44.890603 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5a52752b-b709-41a7-beda-1dbee8876088 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:44.898651 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5a52752b-b709-41a7-beda-1dbee8876088 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.160882 Jul 12 03:50:44.899353 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 96/197] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:44 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:45.187557 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-648e2f34-b00c-4563-918e-c89f74ec547f tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:45.188270 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-648e2f34-b00c-4563-918e-c89f74ec547f tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:45.192192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:50:45.196476 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-648e2f34-b00c-4563-918e-c89f74ec547f tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:45.197179 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-648e2f34-b00c-4563-918e-c89f74ec547f tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:45.198621 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-648e2f34-b00c-4563-918e-c89f74ec547f tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:45.198941 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-648e2f34-b00c-4563-918e-c89f74ec547f tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:45.217518 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-648e2f34-b00c-4563-918e-c89f74ec547f tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] HTTP exception thrown: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-648e2f34-b00c-4563-918e-c89f74ec547f tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Request method failure captured: Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 HTTP/1.1 Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO85UtHEjhW5u63ALyMAjRsstQovPoDRKK5vfdi0xDed4GKBwCBIBidIGE6QQYs352RIDhuYCbIXBPWyrQFAW2laiHhC80fPUr03mq-pxSQTF3lNWh9S3OStUad3zENiVYZaNGljT-B_DSrkpKcYwsu_40m_1i6T6PKTs9DhR0l0PvM Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 38b640d5f6734a6b95b46a6f9dd695ec Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-DeleteServersTestJSON-876828051 Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 03:50:45.222602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 03:50:45.223932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38b640d5f6734a6b95b46a6f9dd695ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38b640d5f6734a6b95b46a6f9dd695ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38b640d5f6734a6b95b46a6f9dd695ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38b640d5f6734a6b95b46a6f9dd695ec"}]}] Jul 12 03:50:45.223932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-DeleteServersTestJSON-876828051 Jul 12 03:50:45.223932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 38b640d5f6734a6b95b46a6f9dd695ec Jul 12 03:50:45.223932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-DeleteServersTestJSON-876828051 Jul 12 03:50:45.223932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-DeleteServersTestJSON-876828051-project Jul 12 03:50:45.223932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 03:50:45.223932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 03:50:45.223932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 70ea64f67f264b20a7c556c625a64f80 Jul 12 03:50:45.223932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-DeleteServersTestJSON-876828051-project Jul 12 03:50:45.223932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 03:50:45.223932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:45.223932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'e02a9be9-245a-4206-b88e-e7f7b9162ce3'} Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:50:45.224772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:45.225908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:50:45.226890 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-648e2f34-b00c-4563-918e-c89f74ec547f tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Returning 404 to user: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:50:45.226890 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-648e2f34-b00c-4563-918e-c89f74ec547f tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 404 len: 111 microversion: 2.1 time: 0.041031 Jul 12 03:50:45.226890 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 102/198] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:45 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:50:45.370409 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b2310e57-91f4-496d-b802-cd749e49dbfb tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:45.371542 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b2310e57-91f4-496d-b802-cd749e49dbfb tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:45.377885 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b2310e57-91f4-496d-b802-cd749e49dbfb tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:45.378359 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b2310e57-91f4-496d-b802-cd749e49dbfb tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:45.379142 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b2310e57-91f4-496d-b802-cd749e49dbfb tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:45.379898 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b2310e57-91f4-496d-b802-cd749e49dbfb tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:45.394610 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-b2310e57-91f4-496d-b802-cd749e49dbfb tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] HTTP exception thrown: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b2310e57-91f4-496d-b802-cd749e49dbfb tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Request method failure captured: Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3/os-volume_attachments HTTP/1.1 Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO85UtHEjhW5u63ALyMAjRsstQovPoDRKK5vfdi0xDed4GKBwCBIBidIGE6QQYs352RIDhuYCbIXBPWyrQFAW2laiHhC80fPUr03mq-pxSQTF3lNWh9S3OStUad3zENiVYZaNGljT-B_DSrkpKcYwsu_40m_1i6T6PKTs9DhR0l0PvM Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 38b640d5f6734a6b95b46a6f9dd695ec Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-DeleteServersTestJSON-876828051 Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:50:45.408827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:50:45.410047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38b640d5f6734a6b95b46a6f9dd695ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38b640d5f6734a6b95b46a6f9dd695ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38b640d5f6734a6b95b46a6f9dd695ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38b640d5f6734a6b95b46a6f9dd695ec"}]}] Jul 12 03:50:45.410047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-DeleteServersTestJSON-876828051 Jul 12 03:50:45.410047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 38b640d5f6734a6b95b46a6f9dd695ec Jul 12 03:50:45.410047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-DeleteServersTestJSON-876828051 Jul 12 03:50:45.410047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-DeleteServersTestJSON-876828051-project Jul 12 03:50:45.410047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:50:45.410047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:50:45.410047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 70ea64f67f264b20a7c556c625a64f80 Jul 12 03:50:45.410047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-DeleteServersTestJSON-876828051-project Jul 12 03:50:45.410047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 03:50:45.410047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:45.410047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'server_id': 'e02a9be9-245a-4206-b88e-e7f7b9162ce3'} Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:50:45.410701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:45.411828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:50:45.413051 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b2310e57-91f4-496d-b802-cd749e49dbfb tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Returning 404 to user: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:50:45.413051 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b2310e57-91f4-496d-b802-cd749e49dbfb tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044116 Jul 12 03:50:45.413051 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 97/199] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 03:50:45 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:50:45.922229 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7c161f8f-32fd-42d2-a0cb-f768fe595a31 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:45.923194 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7c161f8f-32fd-42d2-a0cb-f768fe595a31 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:45.936721 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c161f8f-32fd-42d2-a0cb-f768fe595a31 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:45.937872 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c161f8f-32fd-42d2-a0cb-f768fe595a31 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:45.939006 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c161f8f-32fd-42d2-a0cb-f768fe595a31 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:45.939502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c161f8f-32fd-42d2-a0cb-f768fe595a31 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:46.175338 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7c161f8f-32fd-42d2-a0cb-f768fe595a31 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:46.187573 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7c161f8f-32fd-42d2-a0cb-f768fe595a31 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.274593 Jul 12 03:50:46.191144 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 103/200] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:45 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:46.662977 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0bd16d2a-cd44-40fd-804a-8c1a17fc05c4 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:46.664131 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0bd16d2a-cd44-40fd-804a-8c1a17fc05c4 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:46.674606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0bd16d2a-cd44-40fd-804a-8c1a17fc05c4 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:46.675365 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0bd16d2a-cd44-40fd-804a-8c1a17fc05c4 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:46.676218 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0bd16d2a-cd44-40fd-804a-8c1a17fc05c4 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:46.676653 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0bd16d2a-cd44-40fd-804a-8c1a17fc05c4 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:46.691590 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-0bd16d2a-cd44-40fd-804a-8c1a17fc05c4 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] HTTP exception thrown: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0bd16d2a-cd44-40fd-804a-8c1a17fc05c4 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Request method failure captured: Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: DELETE /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 HTTP/1.1 Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO85UtHEjhW5u63ALyMAjRsstQovPoDRKK5vfdi0xDed4GKBwCBIBidIGE6QQYs352RIDhuYCbIXBPWyrQFAW2laiHhC80fPUr03mq-pxSQTF3lNWh9S3OStUad3zENiVYZaNGljT-B_DSrkpKcYwsu_40m_1i6T6PKTs9DhR0l0PvM Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 38b640d5f6734a6b95b46a6f9dd695ec Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-DeleteServersTestJSON-876828051 Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:50:46.694038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:50:46.695229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38b640d5f6734a6b95b46a6f9dd695ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38b640d5f6734a6b95b46a6f9dd695ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38b640d5f6734a6b95b46a6f9dd695ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38b640d5f6734a6b95b46a6f9dd695ec"}]}] Jul 12 03:50:46.695229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-DeleteServersTestJSON-876828051 Jul 12 03:50:46.695229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 38b640d5f6734a6b95b46a6f9dd695ec Jul 12 03:50:46.695229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-DeleteServersTestJSON-876828051 Jul 12 03:50:46.695229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-DeleteServersTestJSON-876828051-project Jul 12 03:50:46.695229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:50:46.695229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:50:46.695229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 70ea64f67f264b20a7c556c625a64f80 Jul 12 03:50:46.695229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-DeleteServersTestJSON-876828051-project Jul 12 03:50:46.695229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 03:50:46.695229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:46.695229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'e02a9be9-245a-4206-b88e-e7f7b9162ce3'} Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:50:46.695875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:46.697020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:50:46.698061 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0bd16d2a-cd44-40fd-804a-8c1a17fc05c4 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Returning 404 to user: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:50:46.698582 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0bd16d2a-cd44-40fd-804a-8c1a17fc05c4 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 404 len: 111 microversion: 2.1 time: 0.039415 Jul 12 03:50:46.699071 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 98/201] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:50:46 2022] DELETE /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:50:46.707593 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8c221d31-7912-4955-a0ea-875c6fb29445 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:46.708307 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8c221d31-7912-4955-a0ea-875c6fb29445 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] [instance: e02a9be9-245a-4206-b88e-e7f7b9162ce3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:46.715469 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8c221d31-7912-4955-a0ea-875c6fb29445 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:46.716832 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8c221d31-7912-4955-a0ea-875c6fb29445 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:46.717721 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8c221d31-7912-4955-a0ea-875c6fb29445 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:46.718226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8c221d31-7912-4955-a0ea-875c6fb29445 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:46.734277 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-8c221d31-7912-4955-a0ea-875c6fb29445 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] HTTP exception thrown: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8c221d31-7912-4955-a0ea-875c6fb29445 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Request method failure captured: Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 HTTP/1.1 Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO85UtHEjhW5u63ALyMAjRsstQovPoDRKK5vfdi0xDed4GKBwCBIBidIGE6QQYs352RIDhuYCbIXBPWyrQFAW2laiHhC80fPUr03mq-pxSQTF3lNWh9S3OStUad3zENiVYZaNGljT-B_DSrkpKcYwsu_40m_1i6T6PKTs9DhR0l0PvM Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 38b640d5f6734a6b95b46a6f9dd695ec Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-DeleteServersTestJSON-876828051 Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 03:50:46.736196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 03:50:46.737426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_38b640d5f6734a6b95b46a6f9dd695ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/38b640d5f6734a6b95b46a6f9dd695ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38b640d5f6734a6b95b46a6f9dd695ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/38b640d5f6734a6b95b46a6f9dd695ec"}]}] Jul 12 03:50:46.737426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-DeleteServersTestJSON-876828051 Jul 12 03:50:46.737426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 38b640d5f6734a6b95b46a6f9dd695ec Jul 12 03:50:46.737426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-DeleteServersTestJSON-876828051 Jul 12 03:50:46.737426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-DeleteServersTestJSON-876828051-project Jul 12 03:50:46.737426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 03:50:46.737426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 03:50:46.737426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 70ea64f67f264b20a7c556c625a64f80 Jul 12 03:50:46.737426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-DeleteServersTestJSON-876828051-project Jul 12 03:50:46.737426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 03:50:46.737426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:46.737426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'e02a9be9-245a-4206-b88e-e7f7b9162ce3'} Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:50:46.738241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. Jul 12 03:50:46.739380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:50:46.740546 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8c221d31-7912-4955-a0ea-875c6fb29445 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] Returning 404 to user: Instance e02a9be9-245a-4206-b88e-e7f7b9162ce3 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:50:46.740546 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8c221d31-7912-4955-a0ea-875c6fb29445 tempest-DeleteServersTestJSON-876828051 tempest-DeleteServersTestJSON-876828051-project] 10.222.0.20 "GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3" status: 404 len: 111 microversion: 2.1 time: 0.034335 Jul 12 03:50:46.740546 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 104/202] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:46 2022] GET /compute/v2.1/servers/e02a9be9-245a-4206-b88e-e7f7b9162ce3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:50:47.208754 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-49d5aacf-b906-43dd-a992-513d9808ca01 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:47.209360 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-49d5aacf-b906-43dd-a992-513d9808ca01 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:47.215882 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-49d5aacf-b906-43dd-a992-513d9808ca01 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:47.216354 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-49d5aacf-b906-43dd-a992-513d9808ca01 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:47.217108 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-49d5aacf-b906-43dd-a992-513d9808ca01 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:47.217526 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-49d5aacf-b906-43dd-a992-513d9808ca01 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:47.531889 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-49d5aacf-b906-43dd-a992-513d9808ca01 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:47.541390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-49d5aacf-b906-43dd-a992-513d9808ca01 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.337352 Jul 12 03:50:47.542140 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 99/203] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:47 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:48.562021 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-08262f62-6ad9-45b1-ba2d-0bf10067dbe7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:48.564432 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-08262f62-6ad9-45b1-ba2d-0bf10067dbe7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:48.574821 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-08262f62-6ad9-45b1-ba2d-0bf10067dbe7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:48.575887 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-08262f62-6ad9-45b1-ba2d-0bf10067dbe7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:48.580104 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-08262f62-6ad9-45b1-ba2d-0bf10067dbe7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:48.580555 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-08262f62-6ad9-45b1-ba2d-0bf10067dbe7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:48.767395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-08262f62-6ad9-45b1-ba2d-0bf10067dbe7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:48.791037 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-08262f62-6ad9-45b1-ba2d-0bf10067dbe7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.235358 Jul 12 03:50:48.791857 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 105/204] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:48 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:49.808328 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7b80fbd1-4ad6-4cc1-817a-410d45da3310 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:49.809132 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7b80fbd1-4ad6-4cc1-817a-410d45da3310 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:49.816509 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7b80fbd1-4ad6-4cc1-817a-410d45da3310 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:49.817111 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7b80fbd1-4ad6-4cc1-817a-410d45da3310 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:49.818062 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7b80fbd1-4ad6-4cc1-817a-410d45da3310 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:49.818613 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7b80fbd1-4ad6-4cc1-817a-410d45da3310 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:50.140143 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-7b80fbd1-4ad6-4cc1-817a-410d45da3310 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:50.153365 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7b80fbd1-4ad6-4cc1-817a-410d45da3310 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.349308 Jul 12 03:50:50.154376 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 100/205] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:49 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:51.171517 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-81c7c019-f528-4bfa-9307-9d030d8ebb2b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:51.173011 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-81c7c019-f528-4bfa-9307-9d030d8ebb2b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:51.182563 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-81c7c019-f528-4bfa-9307-9d030d8ebb2b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:51.183017 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-81c7c019-f528-4bfa-9307-9d030d8ebb2b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:51.183811 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-81c7c019-f528-4bfa-9307-9d030d8ebb2b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:51.184462 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-81c7c019-f528-4bfa-9307-9d030d8ebb2b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:51.353274 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-81c7c019-f528-4bfa-9307-9d030d8ebb2b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:51.380046 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-81c7c019-f528-4bfa-9307-9d030d8ebb2b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.212964 Jul 12 03:50:51.381815 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 106/206] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:51 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:52.398389 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-38476e0f-9b9e-4b08-8ed0-1f4bba664163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:52.398904 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-38476e0f-9b9e-4b08-8ed0-1f4bba664163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:52.405442 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-38476e0f-9b9e-4b08-8ed0-1f4bba664163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:52.405904 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-38476e0f-9b9e-4b08-8ed0-1f4bba664163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:52.406648 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-38476e0f-9b9e-4b08-8ed0-1f4bba664163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:52.407057 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-38476e0f-9b9e-4b08-8ed0-1f4bba664163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:52.586136 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-38476e0f-9b9e-4b08-8ed0-1f4bba664163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:52.594575 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-38476e0f-9b9e-4b08-8ed0-1f4bba664163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.200082 Jul 12 03:50:52.595256 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 101/207] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:52 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:53.613546 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-967b7ee0-0f22-4b98-bf7a-9ee7ad8fb2fe tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:53.614370 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-967b7ee0-0f22-4b98-bf7a-9ee7ad8fb2fe tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:53.621522 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-967b7ee0-0f22-4b98-bf7a-9ee7ad8fb2fe tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:53.622186 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-967b7ee0-0f22-4b98-bf7a-9ee7ad8fb2fe tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:53.623042 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-967b7ee0-0f22-4b98-bf7a-9ee7ad8fb2fe tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:53.623548 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-967b7ee0-0f22-4b98-bf7a-9ee7ad8fb2fe tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:53.852634 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-967b7ee0-0f22-4b98-bf7a-9ee7ad8fb2fe tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:53.866990 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-967b7ee0-0f22-4b98-bf7a-9ee7ad8fb2fe tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.257636 Jul 12 03:50:53.867582 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 107/208] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:53 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:54.885435 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-914dfeb9-13c1-4e26-81e9-8312ecf8136f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:54.886830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-914dfeb9-13c1-4e26-81e9-8312ecf8136f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:54.895513 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-914dfeb9-13c1-4e26-81e9-8312ecf8136f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:54.899942 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-914dfeb9-13c1-4e26-81e9-8312ecf8136f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:54.901196 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-914dfeb9-13c1-4e26-81e9-8312ecf8136f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:54.901920 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-914dfeb9-13c1-4e26-81e9-8312ecf8136f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:55.051404 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-914dfeb9-13c1-4e26-81e9-8312ecf8136f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:55.055142 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=100 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:50:55.061408 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-914dfeb9-13c1-4e26-81e9-8312ecf8136f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.179857 Jul 12 03:50:55.062218 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 102/209] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:54 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:56.078763 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c052d425-b532-4f24-ac31-431d8c92484d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:56.079614 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c052d425-b532-4f24-ac31-431d8c92484d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:56.086786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c052d425-b532-4f24-ac31-431d8c92484d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:56.087655 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c052d425-b532-4f24-ac31-431d8c92484d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:56.089000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c052d425-b532-4f24-ac31-431d8c92484d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:56.089591 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c052d425-b532-4f24-ac31-431d8c92484d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:56.340736 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c052d425-b532-4f24-ac31-431d8c92484d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:56.348724 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c052d425-b532-4f24-ac31-431d8c92484d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.274039 Jul 12 03:50:56.349643 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 108/210] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:56 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:56.912310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bad092fe-9616-42c6-8fc7-80a6858ec485 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Action: 'create', calling method: .version_select at 0x7fd7faf22700>, body: {"keypair": {"name": "tempest-keypair-1433189775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt9G7gw85hfS9+Eyb6IgXgYgkPh93bJaf+sRdrxfktxFO5WfKGBtVqcQRS+2aSpdlXs7UI2ukumD3RzNx6rD4qS0fle/3QcLvOMFq3mkJMrpjwR5cQLmI7wKmKy0YMN8w=="}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:50:56.933249 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-bad092fe-9616-42c6-8fc7-80a6858ec485 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Getting quotas for project 2ceaecc3b7fc4fed9dce1e3ab1014ed2. Resources: {'key_pairs'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:50:56.937193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-bad092fe-9616-42c6-8fc7-80a6858ec485 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Getting quotas for user b10d2c10313c4be2a8c11cff1eed8852 and project 2ceaecc3b7fc4fed9dce1e3ab1014ed2. Resources: {'key_pairs'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:50:56.980508 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bad092fe-9616-42c6-8fc7-80a6858ec485 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.192636 Jul 12 03:50:56.981120 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 103/211] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 03:50:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:50:57.366589 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1875de75-3c78-4402-9842-a31046086e37 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:57.367209 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1875de75-3c78-4402-9842-a31046086e37 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:57.374211 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1875de75-3c78-4402-9842-a31046086e37 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:57.374691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1875de75-3c78-4402-9842-a31046086e37 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:57.375471 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1875de75-3c78-4402-9842-a31046086e37 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:57.376045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1875de75-3c78-4402-9842-a31046086e37 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:57.401420 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:50:57.572111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1875de75-3c78-4402-9842-a31046086e37 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:57.580687 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1875de75-3c78-4402-9842-a31046086e37 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.217751 Jul 12 03:50:57.581960 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 109/212] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:57 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:58.458322 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1459023402", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80ccb6a1-8d31-4e74-9f2c-15bfc89127e9"}], "security_groups": [{"name": "tempest-securitygroup--866605032"}], "key_name": "tempest-keypair-1433189775", "user_data": "}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:50:58.597754 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-db15ae52-e992-4f87-a859-65243d851573 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:58.599039 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-db15ae52-e992-4f87-a859-65243d851573 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:58.606337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-db15ae52-e992-4f87-a859-65243d851573 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:58.606786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-db15ae52-e992-4f87-a859-65243d851573 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:58.607566 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-db15ae52-e992-4f87-a859-65243d851573 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:58.608135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-db15ae52-e992-4f87-a859-65243d851573 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:58.756214 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-db15ae52-e992-4f87-a859-65243d851573 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:58.764737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-db15ae52-e992-4f87-a859-65243d851573 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.170872 Jul 12 03:50:58.765490 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 110/213] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:58 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:50:58.795910 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.network.neutron [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] validate_networks() for [('80ccb6a1-8d31-4e74-9f2c-15bfc89127e9', None, None, None, None, None)] {{(pid=124435) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:50:59.225835 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Flavor limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:50:59.226259 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Image limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:50:59.226729 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Flavor pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:50:59.227132 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Image pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:50:59.227957 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:50:59.238138 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:59.238725 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:59.240221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:59.240831 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:59.258949 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Getting quotas for project 2ceaecc3b7fc4fed9dce1e3ab1014ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:50:59.265610 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Getting quotas for user b10d2c10313c4be2a8c11cff1eed8852 and project 2ceaecc3b7fc4fed9dce1e3ab1014ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:50:59.278566 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Going to run 1 instances... {{(pid=124435) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:50:59.280949 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124435) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:50:59.351368 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-96c4740f-3bdb-4e22-8611-808c0bda84cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.897396 Jul 12 03:50:59.352910 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 104/214] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:50:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 03:50:59.377047 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-401ab532-b812-4dcb-a882-ba426d84bfbe tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:59.378904 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-401ab532-b812-4dcb-a882-ba426d84bfbe tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:59.457248 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-401ab532-b812-4dcb-a882-ba426d84bfbe tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:50:59.464991 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-401ab532-b812-4dcb-a882-ba426d84bfbe tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1238 microversion: 2.1 time: 0.095960 Jul 12 03:50:59.467869 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 111/215] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:59 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:50:59.783941 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-80b2cff8-5019-4826-91ff-590050c08872 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:50:59.785233 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-80b2cff8-5019-4826-91ff-590050c08872 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:50:59.795208 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-80b2cff8-5019-4826-91ff-590050c08872 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:59.811481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-80b2cff8-5019-4826-91ff-590050c08872 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:50:59.814168 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-80b2cff8-5019-4826-91ff-590050c08872 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:50:59.815914 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-80b2cff8-5019-4826-91ff-590050c08872 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:00.228661 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-80b2cff8-5019-4826-91ff-590050c08872 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:00.239314 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-80b2cff8-5019-4826-91ff-590050c08872 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.460541 Jul 12 03:51:00.248568 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 105/216] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:50:59 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:00.488793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7d60a303-ae83-48c8-9bc4-c5688ea44885 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:00.488793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7d60a303-ae83-48c8-9bc4-c5688ea44885 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:00.495886 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7d60a303-ae83-48c8-9bc4-c5688ea44885 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:00.499547 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7d60a303-ae83-48c8-9bc4-c5688ea44885 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:00.500403 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7d60a303-ae83-48c8-9bc4-c5688ea44885 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:00.500843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7d60a303-ae83-48c8-9bc4-c5688ea44885 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:00.587673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7d60a303-ae83-48c8-9bc4-c5688ea44885 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:00.601468 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7d60a303-ae83-48c8-9bc4-c5688ea44885 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1242 microversion: 2.1 time: 0.122444 Jul 12 03:51:00.602731 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 112/217] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:00 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:01.258037 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-09b8c79d-b55e-48e5-8b3e-550f871cdf22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:01.258623 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-09b8c79d-b55e-48e5-8b3e-550f871cdf22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:01.265428 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-09b8c79d-b55e-48e5-8b3e-550f871cdf22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:01.265896 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-09b8c79d-b55e-48e5-8b3e-550f871cdf22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:01.266670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-09b8c79d-b55e-48e5-8b3e-550f871cdf22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:01.267068 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-09b8c79d-b55e-48e5-8b3e-550f871cdf22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:01.400113 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-09b8c79d-b55e-48e5-8b3e-550f871cdf22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:01.407746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-09b8c79d-b55e-48e5-8b3e-550f871cdf22 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.153549 Jul 12 03:51:01.408342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 106/218] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:01 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:01.618904 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7758907d-5fa8-4ef4-b828-3f2e9e39037b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:01.619501 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7758907d-5fa8-4ef4-b828-3f2e9e39037b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:01.626613 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7758907d-5fa8-4ef4-b828-3f2e9e39037b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:01.627163 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7758907d-5fa8-4ef4-b828-3f2e9e39037b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:01.628040 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7758907d-5fa8-4ef4-b828-3f2e9e39037b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:01.628882 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7758907d-5fa8-4ef4-b828-3f2e9e39037b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:01.695926 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7758907d-5fa8-4ef4-b828-3f2e9e39037b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:01.704022 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7758907d-5fa8-4ef4-b828-3f2e9e39037b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1234 microversion: 2.1 time: 0.089201 Jul 12 03:51:01.704825 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 113/219] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:01 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:02.425328 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-28fa5b4a-6d1f-41b9-be7f-c61e90ad866c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:02.425948 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-28fa5b4a-6d1f-41b9-be7f-c61e90ad866c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:02.432831 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28fa5b4a-6d1f-41b9-be7f-c61e90ad866c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:02.433281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28fa5b4a-6d1f-41b9-be7f-c61e90ad866c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:02.434053 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28fa5b4a-6d1f-41b9-be7f-c61e90ad866c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:02.434475 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28fa5b4a-6d1f-41b9-be7f-c61e90ad866c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:02.568897 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-28fa5b4a-6d1f-41b9-be7f-c61e90ad866c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:02.578096 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-28fa5b4a-6d1f-41b9-be7f-c61e90ad866c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.156127 Jul 12 03:51:02.578096 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 107/220] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:02 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:02.721741 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-796c1a19-735f-44b5-894e-c6fb62e7d603 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:02.722310 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-796c1a19-735f-44b5-894e-c6fb62e7d603 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:02.729149 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-796c1a19-735f-44b5-894e-c6fb62e7d603 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:02.729590 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-796c1a19-735f-44b5-894e-c6fb62e7d603 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:02.730341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-796c1a19-735f-44b5-894e-c6fb62e7d603 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:02.730763 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-796c1a19-735f-44b5-894e-c6fb62e7d603 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:02.793734 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-796c1a19-735f-44b5-894e-c6fb62e7d603 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:02.801382 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-796c1a19-735f-44b5-894e-c6fb62e7d603 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1290 microversion: 2.1 time: 0.083622 Jul 12 03:51:02.801942 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 114/221] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:02 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:03.596372 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-be4db879-4e72-4811-b5b7-31ce35db29fa tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:03.597155 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-be4db879-4e72-4811-b5b7-31ce35db29fa tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:03.605544 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-be4db879-4e72-4811-b5b7-31ce35db29fa tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:03.606184 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-be4db879-4e72-4811-b5b7-31ce35db29fa tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:03.607210 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-be4db879-4e72-4811-b5b7-31ce35db29fa tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:03.607795 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-be4db879-4e72-4811-b5b7-31ce35db29fa tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:03.747707 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-be4db879-4e72-4811-b5b7-31ce35db29fa tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:03.756699 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-be4db879-4e72-4811-b5b7-31ce35db29fa tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.164410 Jul 12 03:51:03.757277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 108/222] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:03 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:03.818250 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c450b115-3cd6-49f6-af6e-a9e6a8fb7764 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:03.818856 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c450b115-3cd6-49f6-af6e-a9e6a8fb7764 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:03.825596 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c450b115-3cd6-49f6-af6e-a9e6a8fb7764 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:03.826037 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c450b115-3cd6-49f6-af6e-a9e6a8fb7764 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:03.826777 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c450b115-3cd6-49f6-af6e-a9e6a8fb7764 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:03.827203 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c450b115-3cd6-49f6-af6e-a9e6a8fb7764 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:03.898562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c450b115-3cd6-49f6-af6e-a9e6a8fb7764 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:03.906139 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c450b115-3cd6-49f6-af6e-a9e6a8fb7764 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1290 microversion: 2.1 time: 0.091772 Jul 12 03:51:03.906696 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 115/223] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:03 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:04.778428 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c3553f64-9047-406a-9cd8-14eee7aea7ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:04.779120 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c3553f64-9047-406a-9cd8-14eee7aea7ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:04.789290 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c3553f64-9047-406a-9cd8-14eee7aea7ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:04.789811 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c3553f64-9047-406a-9cd8-14eee7aea7ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:04.792952 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c3553f64-9047-406a-9cd8-14eee7aea7ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:04.793603 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c3553f64-9047-406a-9cd8-14eee7aea7ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:04.922841 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d508fe04-85ed-4721-9017-c1c95c587410 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:04.923443 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d508fe04-85ed-4721-9017-c1c95c587410 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:04.930397 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d508fe04-85ed-4721-9017-c1c95c587410 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:04.931171 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d508fe04-85ed-4721-9017-c1c95c587410 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:04.932143 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d508fe04-85ed-4721-9017-c1c95c587410 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:04.933249 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d508fe04-85ed-4721-9017-c1c95c587410 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:04.939474 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c3553f64-9047-406a-9cd8-14eee7aea7ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:04.948512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c3553f64-9047-406a-9cd8-14eee7aea7ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.174504 Jul 12 03:51:04.949090 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 109/224] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:04 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:05.006751 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d508fe04-85ed-4721-9017-c1c95c587410 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:05.014321 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d508fe04-85ed-4721-9017-c1c95c587410 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1290 microversion: 2.1 time: 0.095399 Jul 12 03:51:05.014878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 116/225] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:04 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:05.965400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-24f0756e-4275-4bb1-8288-0ee1e9bacf3e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:05.966021 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-24f0756e-4275-4bb1-8288-0ee1e9bacf3e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:05.972818 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-24f0756e-4275-4bb1-8288-0ee1e9bacf3e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:05.973276 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-24f0756e-4275-4bb1-8288-0ee1e9bacf3e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:05.974051 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-24f0756e-4275-4bb1-8288-0ee1e9bacf3e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:05.974482 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-24f0756e-4275-4bb1-8288-0ee1e9bacf3e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:06.030831 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-bb4b4c44-9ca3-433b-b477-bc71a5d23e3e tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:06.031456 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-bb4b4c44-9ca3-433b-b477-bc71a5d23e3e tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:06.038580 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bb4b4c44-9ca3-433b-b477-bc71a5d23e3e tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:06.039021 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bb4b4c44-9ca3-433b-b477-bc71a5d23e3e tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:06.039791 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bb4b4c44-9ca3-433b-b477-bc71a5d23e3e tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:06.040366 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bb4b4c44-9ca3-433b-b477-bc71a5d23e3e tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:06.107032 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-bb4b4c44-9ca3-433b-b477-bc71a5d23e3e tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:06.109909 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-24f0756e-4275-4bb1-8288-0ee1e9bacf3e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:06.114584 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-bb4b4c44-9ca3-433b-b477-bc71a5d23e3e tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1290 microversion: 2.1 time: 0.087720 Jul 12 03:51:06.115150 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 117/226] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:06 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:06.117555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-24f0756e-4275-4bb1-8288-0ee1e9bacf3e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.156109 Jul 12 03:51:06.118118 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 110/227] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:05 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:07.131771 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1d4ab519-f2e7-4e49-9716-021409f78774 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:07.132350 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1d4ab519-f2e7-4e49-9716-021409f78774 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:07.134158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-cfd12277-ce6e-4ac6-bbf4-ececc72154d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:07.134769 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-cfd12277-ce6e-4ac6-bbf4-ececc72154d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:07.136700 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:07.139200 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d4ab519-f2e7-4e49-9716-021409f78774 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:07.139594 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d4ab519-f2e7-4e49-9716-021409f78774 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:07.140368 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d4ab519-f2e7-4e49-9716-021409f78774 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:07.140811 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d4ab519-f2e7-4e49-9716-021409f78774 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:07.141846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cfd12277-ce6e-4ac6-bbf4-ececc72154d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:07.142299 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cfd12277-ce6e-4ac6-bbf4-ececc72154d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:07.143411 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cfd12277-ce6e-4ac6-bbf4-ececc72154d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:07.144051 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cfd12277-ce6e-4ac6-bbf4-ececc72154d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:07.203218 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1d4ab519-f2e7-4e49-9716-021409f78774 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:07.210897 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1d4ab519-f2e7-4e49-9716-021409f78774 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1298 microversion: 2.1 time: 0.083101 Jul 12 03:51:07.211463 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 118/228] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:07 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:07.278536 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-cfd12277-ce6e-4ac6-bbf4-ececc72154d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:07.286515 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-cfd12277-ce6e-4ac6-bbf4-ececc72154d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1519 microversion: 2.1 time: 0.156177 Jul 12 03:51:07.287094 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 111/229] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:07 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:08.227810 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5779123b-ea06-4545-95b3-df2d48c4828c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:08.228793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5779123b-ea06-4545-95b3-df2d48c4828c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:08.235393 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5779123b-ea06-4545-95b3-df2d48c4828c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:08.235831 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5779123b-ea06-4545-95b3-df2d48c4828c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:08.236774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5779123b-ea06-4545-95b3-df2d48c4828c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:08.237211 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5779123b-ea06-4545-95b3-df2d48c4828c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:08.302598 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-32b1f2e5-f309-4078-9f07-aef18df87375 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:08.303822 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-32b1f2e5-f309-4078-9f07-aef18df87375 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:08.313204 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-32b1f2e5-f309-4078-9f07-aef18df87375 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:08.313365 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5779123b-ea06-4545-95b3-df2d48c4828c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:08.313988 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-32b1f2e5-f309-4078-9f07-aef18df87375 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:08.314919 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-32b1f2e5-f309-4078-9f07-aef18df87375 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:08.315490 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-32b1f2e5-f309-4078-9f07-aef18df87375 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:08.325254 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5779123b-ea06-4545-95b3-df2d48c4828c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1296 microversion: 2.1 time: 0.101201 Jul 12 03:51:08.334835 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 119/230] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:08 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1296 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:08.574925 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-32b1f2e5-f309-4078-9f07-aef18df87375 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:08.584509 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-32b1f2e5-f309-4078-9f07-aef18df87375 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1499 microversion: 2.1 time: 0.285617 Jul 12 03:51:08.596040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 112/231] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:08 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1499 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:08.604391 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-464e982d-1e47-4db0-b7ac-6bc7b2b796c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:08.605004 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-464e982d-1e47-4db0-b7ac-6bc7b2b796c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:08.611856 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-464e982d-1e47-4db0-b7ac-6bc7b2b796c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:08.615076 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-464e982d-1e47-4db0-b7ac-6bc7b2b796c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:08.615076 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-464e982d-1e47-4db0-b7ac-6bc7b2b796c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:08.615076 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-464e982d-1e47-4db0-b7ac-6bc7b2b796c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:08.842373 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-464e982d-1e47-4db0-b7ac-6bc7b2b796c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:08.865094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-464e982d-1e47-4db0-b7ac-6bc7b2b796c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1514 microversion: 2.1 time: 0.264647 Jul 12 03:51:08.865693 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 120/232] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:08 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:09.343012 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8f103966-9660-415e-9859-4ba63e3e14d6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:09.344234 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8f103966-9660-415e-9859-4ba63e3e14d6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:09.346315 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:09.347027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=10 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:09.356058 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8f103966-9660-415e-9859-4ba63e3e14d6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:09.356523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8f103966-9660-415e-9859-4ba63e3e14d6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:09.357335 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8f103966-9660-415e-9859-4ba63e3e14d6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:09.357931 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8f103966-9660-415e-9859-4ba63e3e14d6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:09.709256 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8f103966-9660-415e-9859-4ba63e3e14d6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:09.717936 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8f103966-9660-415e-9859-4ba63e3e14d6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1363 microversion: 2.1 time: 0.379065 Jul 12 03:51:09.718759 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 113/233] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:09 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:09.894940 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-1f56ae2b-b91b-4f02-9b2b-260767dcc4ae req-8039529e-2e18-4702-8cc2-a755d1e878c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83ba0f3-55f9-4a38-9794-46bb9876f0d7", "tag": "8a62f409-2f00-4669-85c4-d882010074e6"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:09.907178 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:09.910559 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-1f56ae2b-b91b-4f02-9b2b-260767dcc4ae req-8039529e-2e18-4702-8cc2-a755d1e878c4 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:09.910559 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-1f56ae2b-b91b-4f02-9b2b-260767dcc4ae req-8039529e-2e18-4702-8cc2-a755d1e878c4 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:09.939766 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-1f56ae2b-b91b-4f02-9b2b-260767dcc4ae req-8039529e-2e18-4702-8cc2-a755d1e878c4 service nova] Creating event network-changed:8a62f409-2f00-4669-85c4-d882010074e6 for instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 on hv-cinder-84773 Jul 12 03:51:09.952967 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-1f56ae2b-b91b-4f02-9b2b-260767dcc4ae req-8039529e-2e18-4702-8cc2-a755d1e878c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062676 Jul 12 03:51:09.960653 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 121/234] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:51:10.477887 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-cb242cb9-f77d-4021-830b-051011e27679 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:10.480756 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-cb242cb9-f77d-4021-830b-051011e27679 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:10.492300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cb242cb9-f77d-4021-830b-051011e27679 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:10.496769 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cb242cb9-f77d-4021-830b-051011e27679 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:10.497742 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cb242cb9-f77d-4021-830b-051011e27679 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:10.498946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cb242cb9-f77d-4021-830b-051011e27679 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:10.529915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.objects.instance [None req-cb242cb9-f77d-4021-830b-051011e27679 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lazy-loading 'flavor' on Instance uuid 48f1cbdb-c631-4f89-b3c5-8e74819e942d {{(pid=124435) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:51:10.638377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-cb242cb9-f77d-4021-830b-051011e27679 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "POST /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d/action" status: 200 len: 32 microversion: 2.1 time: 0.165430 Jul 12 03:51:10.639405 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 114/235] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 03:51:10 2022] POST /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 03:51:10.649593 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0a396afd-a0c9-4ca3-a002-72439dbc6e61 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:10.650750 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0a396afd-a0c9-4ca3-a002-72439dbc6e61 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:10.658548 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0a396afd-a0c9-4ca3-a002-72439dbc6e61 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:10.658911 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0a396afd-a0c9-4ca3-a002-72439dbc6e61 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:10.660174 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0a396afd-a0c9-4ca3-a002-72439dbc6e61 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:10.660735 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0a396afd-a0c9-4ca3-a002-72439dbc6e61 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:10.736594 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5e9c0e96-0b2d-44d9-8145-6c713e57c611 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:10.737831 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5e9c0e96-0b2d-44d9-8145-6c713e57c611 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:10.745233 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5e9c0e96-0b2d-44d9-8145-6c713e57c611 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:10.745790 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5e9c0e96-0b2d-44d9-8145-6c713e57c611 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:10.746621 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5e9c0e96-0b2d-44d9-8145-6c713e57c611 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:10.747251 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5e9c0e96-0b2d-44d9-8145-6c713e57c611 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:10.868693 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0a396afd-a0c9-4ca3-a002-72439dbc6e61 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:10.877176 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0a396afd-a0c9-4ca3-a002-72439dbc6e61 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.232353 Jul 12 03:51:10.887045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 122/236] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:10 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:10.957602 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5e9c0e96-0b2d-44d9-8145-6c713e57c611 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:10.981054 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5e9c0e96-0b2d-44d9-8145-6c713e57c611 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1363 microversion: 2.1 time: 0.249887 Jul 12 03:51:10.982271 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 115/237] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:10 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:11.894897 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-162956b0-9abf-4103-b6de-4504dd74f595 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:11.895483 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-162956b0-9abf-4103-b6de-4504dd74f595 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:11.902230 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-162956b0-9abf-4103-b6de-4504dd74f595 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:11.902855 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-162956b0-9abf-4103-b6de-4504dd74f595 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:11.903610 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-162956b0-9abf-4103-b6de-4504dd74f595 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:11.904099 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-162956b0-9abf-4103-b6de-4504dd74f595 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:11.997979 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-25080773-7294-4c79-8aa9-54d231e8222f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:11.998595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-25080773-7294-4c79-8aa9-54d231e8222f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:12.005749 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25080773-7294-4c79-8aa9-54d231e8222f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:12.005749 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25080773-7294-4c79-8aa9-54d231e8222f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:12.006256 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25080773-7294-4c79-8aa9-54d231e8222f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:12.006804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25080773-7294-4c79-8aa9-54d231e8222f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:12.059175 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-162956b0-9abf-4103-b6de-4504dd74f595 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:12.067054 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-162956b0-9abf-4103-b6de-4504dd74f595 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.176316 Jul 12 03:51:12.067624 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 123/238] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:11 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:12.143072 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-25080773-7294-4c79-8aa9-54d231e8222f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:12.150856 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-25080773-7294-4c79-8aa9-54d231e8222f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1363 microversion: 2.1 time: 0.156869 Jul 12 03:51:12.151429 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 116/239] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:11 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:13.083541 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a759252d-4c22-4326-8024-36a6d9fde43d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:13.084366 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a759252d-4c22-4326-8024-36a6d9fde43d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:13.091525 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a759252d-4c22-4326-8024-36a6d9fde43d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:13.091980 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a759252d-4c22-4326-8024-36a6d9fde43d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:13.092807 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a759252d-4c22-4326-8024-36a6d9fde43d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:13.093361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a759252d-4c22-4326-8024-36a6d9fde43d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:13.169802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-31c83af3-495d-4a0e-963b-70a8789bb0de tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:13.170471 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-31c83af3-495d-4a0e-963b-70a8789bb0de tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:13.191646 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-31c83af3-495d-4a0e-963b-70a8789bb0de tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:13.192354 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-31c83af3-495d-4a0e-963b-70a8789bb0de tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:13.205203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-31c83af3-495d-4a0e-963b-70a8789bb0de tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:13.206130 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-31c83af3-495d-4a0e-963b-70a8789bb0de tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:13.464580 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a759252d-4c22-4326-8024-36a6d9fde43d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:13.486123 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-31c83af3-495d-4a0e-963b-70a8789bb0de tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:13.498084 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-31c83af3-495d-4a0e-963b-70a8789bb0de tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1363 microversion: 2.1 time: 0.332521 Jul 12 03:51:13.500983 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a759252d-4c22-4326-8024-36a6d9fde43d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.392912 Jul 12 03:51:13.503513 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 117/240] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:13 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:13.515248 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 124/241] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:13 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:13.857532 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1648615803", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "networks": [{"uuid": "1fbf7062-dd80-4df4-aff2-3f3cec0e4cd4"}]}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:13.941330 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.network.neutron [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] validate_networks() for [('1fbf7062-dd80-4df4-aff2-3f3cec0e4cd4', None, None, None, None, None)] {{(pid=124435) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:51:14.519981 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ef081864-6e68-4e42-b5c1-9b7b95ca362a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:14.521310 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ef081864-6e68-4e42-b5c1-9b7b95ca362a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:14.528036 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ef081864-6e68-4e42-b5c1-9b7b95ca362a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:14.528492 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ef081864-6e68-4e42-b5c1-9b7b95ca362a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:14.529264 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ef081864-6e68-4e42-b5c1-9b7b95ca362a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:14.529697 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ef081864-6e68-4e42-b5c1-9b7b95ca362a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:14.679805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ef081864-6e68-4e42-b5c1-9b7b95ca362a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:14.687788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ef081864-6e68-4e42-b5c1-9b7b95ca362a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1363 microversion: 2.1 time: 0.172789 Jul 12 03:51:14.697603 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 125/242] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:14 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:14.702615 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-39661a44-2476-48b3-9c3a-6b721ea7c63c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:14.703237 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-39661a44-2476-48b3-9c3a-6b721ea7c63c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:14.711049 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-39661a44-2476-48b3-9c3a-6b721ea7c63c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:14.711497 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-39661a44-2476-48b3-9c3a-6b721ea7c63c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:14.712568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-39661a44-2476-48b3-9c3a-6b721ea7c63c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:14.712706 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-39661a44-2476-48b3-9c3a-6b721ea7c63c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:14.878503 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-39661a44-2476-48b3-9c3a-6b721ea7c63c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:14.886914 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-39661a44-2476-48b3-9c3a-6b721ea7c63c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.188167 Jul 12 03:51:14.888043 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 126/243] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:14 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:15.032852 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Flavor limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:51:15.033938 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Image limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:51:15.034441 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Flavor pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:51:15.035387 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Image pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:51:15.035858 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:51:15.046916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:15.047363 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:15.048394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:15.048831 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:15.069925 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Getting quotas for project 3e33bfd157c64f8688b9720d80a3a8af. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:51:15.080143 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Getting quotas for user 2ea01587de8f4d5584d1b12ef042d421 and project 3e33bfd157c64f8688b9720d80a3a8af. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:51:15.097022 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Going to run 1 instances... {{(pid=124435) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:51:15.099325 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124435) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:51:15.146225 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-515c6282-16c2-4120-a7ec-972d24f1f4cc tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.293041 Jul 12 03:51:15.146898 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 118/244] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 03:51:15.158461 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8abc2ef5-c5b2-48a6-b861-ba3cc0750832 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:15.159639 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8abc2ef5-c5b2-48a6-b861-ba3cc0750832 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:15.223607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8abc2ef5-c5b2-48a6-b861-ba3cc0750832 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:15.232170 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8abc2ef5-c5b2-48a6-b861-ba3cc0750832 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1214 microversion: 2.1 time: 0.078546 Jul 12 03:51:15.233798 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 127/245] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:15 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:15.679593 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-272507dd-8cd5-48e6-8a12-278237cc2ba5 req-41ac3e16-da6c-45e2-b9b3-86602064fc58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83ba0f3-55f9-4a38-9794-46bb9876f0d7", "name": "network-vif-plugged", "status": "completed", "tag": "8a62f409-2f00-4669-85c4-d882010074e6"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:15.688831 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-272507dd-8cd5-48e6-8a12-278237cc2ba5 req-41ac3e16-da6c-45e2-b9b3-86602064fc58 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:15.689337 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-272507dd-8cd5-48e6-8a12-278237cc2ba5 req-41ac3e16-da6c-45e2-b9b3-86602064fc58 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:15.704865 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-bcf1d958-7cd6-4fae-b73a-aab790e18dea tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:15.705645 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-bcf1d958-7cd6-4fae-b73a-aab790e18dea tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:15.708475 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=56 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:15.721443 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bcf1d958-7cd6-4fae-b73a-aab790e18dea tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:15.723535 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bcf1d958-7cd6-4fae-b73a-aab790e18dea tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:15.726488 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-272507dd-8cd5-48e6-8a12-278237cc2ba5 req-41ac3e16-da6c-45e2-b9b3-86602064fc58 service nova] Creating event network-vif-plugged:8a62f409-2f00-4669-85c4-d882010074e6 for instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 on hv-cinder-84773 Jul 12 03:51:15.730030 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bcf1d958-7cd6-4fae-b73a-aab790e18dea tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:15.730791 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bcf1d958-7cd6-4fae-b73a-aab790e18dea tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:15.736918 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-272507dd-8cd5-48e6-8a12-278237cc2ba5 req-41ac3e16-da6c-45e2-b9b3-86602064fc58 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061167 Jul 12 03:51:15.738126 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 119/246] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:51:15.768533 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:15.906743 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3dba7c5b-cb63-4b71-9bd1-4aa16834b58f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:15.918853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3dba7c5b-cb63-4b71-9bd1-4aa16834b58f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:15.942871 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3dba7c5b-cb63-4b71-9bd1-4aa16834b58f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:15.943392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3dba7c5b-cb63-4b71-9bd1-4aa16834b58f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:15.948291 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3dba7c5b-cb63-4b71-9bd1-4aa16834b58f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:15.949180 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3dba7c5b-cb63-4b71-9bd1-4aa16834b58f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:15.975723 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:15.980335 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-bcf1d958-7cd6-4fae-b73a-aab790e18dea tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:15.989824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-bcf1d958-7cd6-4fae-b73a-aab790e18dea tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1363 microversion: 2.1 time: 0.289085 Jul 12 03:51:15.992386 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 128/247] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:15 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:16.100306 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3dba7c5b-cb63-4b71-9bd1-4aa16834b58f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:16.108273 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3dba7c5b-cb63-4b71-9bd1-4aa16834b58f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.207013 Jul 12 03:51:16.117506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 120/248] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:15 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:16.249202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9e77b390-1afa-402b-856b-50c9a3cb1a25 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:16.249985 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-9e77b390-1afa-402b-856b-50c9a3cb1a25 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:16.256694 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9e77b390-1afa-402b-856b-50c9a3cb1a25 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:16.258187 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9e77b390-1afa-402b-856b-50c9a3cb1a25 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:16.259051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9e77b390-1afa-402b-856b-50c9a3cb1a25 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:16.259502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9e77b390-1afa-402b-856b-50c9a3cb1a25 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:16.328050 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9e77b390-1afa-402b-856b-50c9a3cb1a25 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:16.335855 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9e77b390-1afa-402b-856b-50c9a3cb1a25 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1210 microversion: 2.1 time: 0.090831 Jul 12 03:51:16.336519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 129/249] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:16 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:17.006588 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-293afa7d-05b6-450f-8b6f-9044e82b46dc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:17.007192 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-293afa7d-05b6-450f-8b6f-9044e82b46dc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:17.013262 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-293afa7d-05b6-450f-8b6f-9044e82b46dc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:17.013707 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-293afa7d-05b6-450f-8b6f-9044e82b46dc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:17.014463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-293afa7d-05b6-450f-8b6f-9044e82b46dc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:17.014897 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-293afa7d-05b6-450f-8b6f-9044e82b46dc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:17.125512 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-dde19b00-4d2b-40ff-b456-a57d9eebea42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:17.126178 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-dde19b00-4d2b-40ff-b456-a57d9eebea42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:17.133291 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dde19b00-4d2b-40ff-b456-a57d9eebea42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:17.133857 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dde19b00-4d2b-40ff-b456-a57d9eebea42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:17.134639 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dde19b00-4d2b-40ff-b456-a57d9eebea42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:17.135077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dde19b00-4d2b-40ff-b456-a57d9eebea42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:17.147668 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-293afa7d-05b6-450f-8b6f-9044e82b46dc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:17.157892 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-293afa7d-05b6-450f-8b6f-9044e82b46dc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1363 microversion: 2.1 time: 0.154449 Jul 12 03:51:17.158688 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 121/250] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:17 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:17.284808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-dde19b00-4d2b-40ff-b456-a57d9eebea42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:17.292494 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-dde19b00-4d2b-40ff-b456-a57d9eebea42 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.171261 Jul 12 03:51:17.293155 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 130/251] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:17 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:17.353004 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5f80c52b-23ca-4f23-b3bb-113f38c9e2e0 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:17.353613 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5f80c52b-23ca-4f23-b3bb-113f38c9e2e0 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:17.359770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f80c52b-23ca-4f23-b3bb-113f38c9e2e0 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:17.360258 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f80c52b-23ca-4f23-b3bb-113f38c9e2e0 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:17.360989 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f80c52b-23ca-4f23-b3bb-113f38c9e2e0 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:17.361423 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f80c52b-23ca-4f23-b3bb-113f38c9e2e0 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:17.431936 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5f80c52b-23ca-4f23-b3bb-113f38c9e2e0 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:17.439497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5f80c52b-23ca-4f23-b3bb-113f38c9e2e0 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1266 microversion: 2.1 time: 0.090393 Jul 12 03:51:17.446752 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 122/252] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:17 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:18.175136 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-afb5338c-db3d-4703-97fc-af2c3d214bce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:18.178652 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-afb5338c-db3d-4703-97fc-af2c3d214bce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:18.188136 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-afb5338c-db3d-4703-97fc-af2c3d214bce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:18.188988 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-afb5338c-db3d-4703-97fc-af2c3d214bce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:18.190048 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-afb5338c-db3d-4703-97fc-af2c3d214bce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:18.190708 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-afb5338c-db3d-4703-97fc-af2c3d214bce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:18.310717 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-256ae47b-4bee-4e1c-8a91-4d914c209bc1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:18.311410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-256ae47b-4bee-4e1c-8a91-4d914c209bc1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:18.318113 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-256ae47b-4bee-4e1c-8a91-4d914c209bc1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:18.318637 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-256ae47b-4bee-4e1c-8a91-4d914c209bc1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:18.319608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-256ae47b-4bee-4e1c-8a91-4d914c209bc1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:18.320272 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-256ae47b-4bee-4e1c-8a91-4d914c209bc1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:18.372522 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-afb5338c-db3d-4703-97fc-af2c3d214bce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:18.383523 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-afb5338c-db3d-4703-97fc-af2c3d214bce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1363 microversion: 2.1 time: 0.212357 Jul 12 03:51:18.384669 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 131/253] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:18 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:18.460248 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-589b0c46-a6c7-4ec4-8ef5-3ce6c5cb684d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:18.461536 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-589b0c46-a6c7-4ec4-8ef5-3ce6c5cb684d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:18.467736 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-589b0c46-a6c7-4ec4-8ef5-3ce6c5cb684d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:18.468229 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-589b0c46-a6c7-4ec4-8ef5-3ce6c5cb684d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:18.468997 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-589b0c46-a6c7-4ec4-8ef5-3ce6c5cb684d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:18.469628 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-589b0c46-a6c7-4ec4-8ef5-3ce6c5cb684d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:18.553331 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-589b0c46-a6c7-4ec4-8ef5-3ce6c5cb684d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:18.561614 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-589b0c46-a6c7-4ec4-8ef5-3ce6c5cb684d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1272 microversion: 2.1 time: 0.106871 Jul 12 03:51:18.572619 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 132/254] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:18 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:18.573397 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-256ae47b-4bee-4e1c-8a91-4d914c209bc1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:18.576367 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-256ae47b-4bee-4e1c-8a91-4d914c209bc1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.270479 Jul 12 03:51:18.577235 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 123/255] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:18 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:19.402342 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c1a6002d-0a26-4684-84c6-966a362c9374 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:19.402915 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c1a6002d-0a26-4684-84c6-966a362c9374 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:19.409624 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c1a6002d-0a26-4684-84c6-966a362c9374 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:19.410070 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c1a6002d-0a26-4684-84c6-966a362c9374 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:19.410982 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c1a6002d-0a26-4684-84c6-966a362c9374 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:19.411407 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c1a6002d-0a26-4684-84c6-966a362c9374 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:19.547792 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c1a6002d-0a26-4684-84c6-966a362c9374 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:19.559201 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c1a6002d-0a26-4684-84c6-966a362c9374 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1549 microversion: 2.1 time: 0.160814 Jul 12 03:51:19.560588 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 133/256] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:19 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:19.577286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5f95c2b1-1cf2-44e5-ac6d-9ec7240617e8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:19.577844 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5f95c2b1-1cf2-44e5-ac6d-9ec7240617e8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:19.584376 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f95c2b1-1cf2-44e5-ac6d-9ec7240617e8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:19.584827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f95c2b1-1cf2-44e5-ac6d-9ec7240617e8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:19.585636 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f95c2b1-1cf2-44e5-ac6d-9ec7240617e8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:19.585931 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f5c07ced-d61f-43cd-8487-37e9c739a235 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:19.586061 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f95c2b1-1cf2-44e5-ac6d-9ec7240617e8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:19.586649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f5c07ced-d61f-43cd-8487-37e9c739a235 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:19.593050 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f5c07ced-d61f-43cd-8487-37e9c739a235 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:19.593473 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f5c07ced-d61f-43cd-8487-37e9c739a235 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:19.594236 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f5c07ced-d61f-43cd-8487-37e9c739a235 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:19.594661 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f5c07ced-d61f-43cd-8487-37e9c739a235 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:19.729880 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f5c07ced-d61f-43cd-8487-37e9c739a235 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:19.737673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f5c07ced-d61f-43cd-8487-37e9c739a235 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1314 microversion: 2.1 time: 0.155815 Jul 12 03:51:19.738371 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 134/257] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:19 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:19.743683 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cad5e9f3-d53b-4739-98fc-8a8edc946deb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:19.744455 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-cad5e9f3-d53b-4739-98fc-8a8edc946deb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:19.751415 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cad5e9f3-d53b-4739-98fc-8a8edc946deb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:19.751973 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cad5e9f3-d53b-4739-98fc-8a8edc946deb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:19.752978 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cad5e9f3-d53b-4739-98fc-8a8edc946deb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:19.753478 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cad5e9f3-d53b-4739-98fc-8a8edc946deb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:19.759343 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5f95c2b1-1cf2-44e5-ac6d-9ec7240617e8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186734 Jul 12 03:51:19.760121 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 124/258] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 03:51:19 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/os-interface => generated 285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 03:51:20.020051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cad5e9f3-d53b-4739-98fc-8a8edc946deb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:20.029742 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cad5e9f3-d53b-4739-98fc-8a8edc946deb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.290315 Jul 12 03:51:20.030352 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 135/259] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:19 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:20.754887 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9103cb2d-506b-445b-9963-8ec1c7859394 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:20.755489 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9103cb2d-506b-445b-9963-8ec1c7859394 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:20.772419 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9103cb2d-506b-445b-9963-8ec1c7859394 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:20.773123 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9103cb2d-506b-445b-9963-8ec1c7859394 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:20.777956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9103cb2d-506b-445b-9963-8ec1c7859394 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:20.778635 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9103cb2d-506b-445b-9963-8ec1c7859394 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:20.887254 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-f929ba1f-f386-454a-905f-b4cca6159602 req-9e044fdc-6367-4c02-ba21-1c5c78f8d09b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed319c48-b1ca-431c-b513-311df9d609aa", "tag": "f6ccf5de-bcd7-4b16-8490-ab42e8fbffb3"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:20.906667 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-f929ba1f-f386-454a-905f-b4cca6159602 req-9e044fdc-6367-4c02-ba21-1c5c78f8d09b service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:20.907707 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-f929ba1f-f386-454a-905f-b4cca6159602 req-9e044fdc-6367-4c02-ba21-1c5c78f8d09b service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:20.922827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-f929ba1f-f386-454a-905f-b4cca6159602 req-9e044fdc-6367-4c02-ba21-1c5c78f8d09b service nova] Creating event network-changed:f6ccf5de-bcd7-4b16-8490-ab42e8fbffb3 for instance ed319c48-b1ca-431c-b513-311df9d609aa on hv-cinder-84773 Jul 12 03:51:20.928837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-f929ba1f-f386-454a-905f-b4cca6159602 req-9e044fdc-6367-4c02-ba21-1c5c78f8d09b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047991 Jul 12 03:51:20.930035 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 136/260] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:51:21.052856 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1e113c8f-aabe-4352-82b9-a577b14e4798 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:21.056558 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1e113c8f-aabe-4352-82b9-a577b14e4798 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:21.070938 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1e113c8f-aabe-4352-82b9-a577b14e4798 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:21.071385 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1e113c8f-aabe-4352-82b9-a577b14e4798 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:21.072198 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1e113c8f-aabe-4352-82b9-a577b14e4798 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:21.072631 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1e113c8f-aabe-4352-82b9-a577b14e4798 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:21.205763 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9103cb2d-506b-445b-9963-8ec1c7859394 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:21.217351 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9103cb2d-506b-445b-9963-8ec1c7859394 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1314 microversion: 2.1 time: 0.466454 Jul 12 03:51:21.218314 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 125/261] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:20 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:21.331230 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1e113c8f-aabe-4352-82b9-a577b14e4798 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:21.339158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-f2615fcf-5f00-4a6f-9b4c-275c387f61fd req-3afd03f7-611f-4454-a295-8bea1fe04dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83ba0f3-55f9-4a38-9794-46bb9876f0d7", "tag": "8a62f409-2f00-4669-85c4-d882010074e6"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:21.342593 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1e113c8f-aabe-4352-82b9-a577b14e4798 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.295717 Jul 12 03:51:21.348356 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 137/262] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:21 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:21.349352 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-f2615fcf-5f00-4a6f-9b4c-275c387f61fd req-3afd03f7-611f-4454-a295-8bea1fe04dad service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:21.349863 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-f2615fcf-5f00-4a6f-9b4c-275c387f61fd req-3afd03f7-611f-4454-a295-8bea1fe04dad service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:21.362104 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-f2615fcf-5f00-4a6f-9b4c-275c387f61fd req-3afd03f7-611f-4454-a295-8bea1fe04dad service nova] Creating event network-changed:8a62f409-2f00-4669-85c4-d882010074e6 for instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 on hv-cinder-84773 Jul 12 03:51:21.367887 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-f2615fcf-5f00-4a6f-9b4c-275c387f61fd req-3afd03f7-611f-4454-a295-8bea1fe04dad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032477 Jul 12 03:51:21.373700 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 126/263] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:51:22.236685 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d1dd2ce5-ed69-493e-a0d1-840bafa7200a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:22.237298 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d1dd2ce5-ed69-493e-a0d1-840bafa7200a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:22.247258 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1dd2ce5-ed69-493e-a0d1-840bafa7200a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:22.248032 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1dd2ce5-ed69-493e-a0d1-840bafa7200a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:22.248803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1dd2ce5-ed69-493e-a0d1-840bafa7200a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:22.249237 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1dd2ce5-ed69-493e-a0d1-840bafa7200a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:22.360126 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a622948d-e919-43f3-8f4a-c8ba262b74f4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:22.361154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a622948d-e919-43f3-8f4a-c8ba262b74f4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:22.367904 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a622948d-e919-43f3-8f4a-c8ba262b74f4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:22.370782 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a622948d-e919-43f3-8f4a-c8ba262b74f4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:22.371954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a622948d-e919-43f3-8f4a-c8ba262b74f4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:22.372713 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a622948d-e919-43f3-8f4a-c8ba262b74f4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:22.464323 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d1dd2ce5-ed69-493e-a0d1-840bafa7200a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:22.480775 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d1dd2ce5-ed69-493e-a0d1-840bafa7200a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1314 microversion: 2.1 time: 0.247803 Jul 12 03:51:22.496052 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 138/264] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:22 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:22.654291 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a622948d-e919-43f3-8f4a-c8ba262b74f4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:22.665572 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a622948d-e919-43f3-8f4a-c8ba262b74f4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.310473 Jul 12 03:51:22.666772 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 127/265] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:22 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:23.504473 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-642e9cb8-b9ab-4e09-aafe-e63c2e365390 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:23.506224 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-642e9cb8-b9ab-4e09-aafe-e63c2e365390 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:23.513284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-642e9cb8-b9ab-4e09-aafe-e63c2e365390 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:23.513970 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-642e9cb8-b9ab-4e09-aafe-e63c2e365390 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:23.514928 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-642e9cb8-b9ab-4e09-aafe-e63c2e365390 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:23.515498 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-642e9cb8-b9ab-4e09-aafe-e63c2e365390 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:23.682848 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-70ba77e0-af8d-466e-a413-e196523b9c05 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:23.684107 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-70ba77e0-af8d-466e-a413-e196523b9c05 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:23.693918 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-70ba77e0-af8d-466e-a413-e196523b9c05 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:23.694436 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-70ba77e0-af8d-466e-a413-e196523b9c05 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:23.695438 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-70ba77e0-af8d-466e-a413-e196523b9c05 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:23.695925 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-70ba77e0-af8d-466e-a413-e196523b9c05 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:23.759626 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-642e9cb8-b9ab-4e09-aafe-e63c2e365390 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:23.776262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-642e9cb8-b9ab-4e09-aafe-e63c2e365390 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1314 microversion: 2.1 time: 0.275918 Jul 12 03:51:23.787827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 139/266] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:23 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:23.852985 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-70ba77e0-af8d-466e-a413-e196523b9c05 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:23.861026 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-70ba77e0-af8d-466e-a413-e196523b9c05 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.181944 Jul 12 03:51:23.861719 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 128/267] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:23 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:24.795413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d25a0cb4-00ac-45fc-9f4f-ed09733c7e63 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:24.796613 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d25a0cb4-00ac-45fc-9f4f-ed09733c7e63 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:24.803487 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d25a0cb4-00ac-45fc-9f4f-ed09733c7e63 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:24.805174 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d25a0cb4-00ac-45fc-9f4f-ed09733c7e63 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:24.806134 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d25a0cb4-00ac-45fc-9f4f-ed09733c7e63 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:24.806581 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d25a0cb4-00ac-45fc-9f4f-ed09733c7e63 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:24.878886 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e376ca1b-f88f-4e67-845a-7473e5fbbd67 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:24.879475 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e376ca1b-f88f-4e67-845a-7473e5fbbd67 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:24.886800 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e376ca1b-f88f-4e67-845a-7473e5fbbd67 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:24.887252 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e376ca1b-f88f-4e67-845a-7473e5fbbd67 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:24.888254 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e376ca1b-f88f-4e67-845a-7473e5fbbd67 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:24.889273 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e376ca1b-f88f-4e67-845a-7473e5fbbd67 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:24.974451 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d25a0cb4-00ac-45fc-9f4f-ed09733c7e63 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:24.984238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d25a0cb4-00ac-45fc-9f4f-ed09733c7e63 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1314 microversion: 2.1 time: 0.194327 Jul 12 03:51:24.985733 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 140/268] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:24 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:25.044549 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e376ca1b-f88f-4e67-845a-7473e5fbbd67 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:25.053840 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e376ca1b-f88f-4e67-845a-7473e5fbbd67 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.178562 Jul 12 03:51:25.056049 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 129/269] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:24 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:26.003797 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4cc6016a-9129-4a1e-a194-8d1c9f4b9717 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:26.005795 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4cc6016a-9129-4a1e-a194-8d1c9f4b9717 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:26.011868 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:26.014469 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4cc6016a-9129-4a1e-a194-8d1c9f4b9717 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:26.015233 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4cc6016a-9129-4a1e-a194-8d1c9f4b9717 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:26.016227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4cc6016a-9129-4a1e-a194-8d1c9f4b9717 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:26.016839 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4cc6016a-9129-4a1e-a194-8d1c9f4b9717 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:26.071268 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4a55ca61-14c9-4c8a-b09d-cb1b0eea9c64 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:26.076352 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4a55ca61-14c9-4c8a-b09d-cb1b0eea9c64 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:26.089312 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:26.090606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=6 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:26.093252 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4a55ca61-14c9-4c8a-b09d-cb1b0eea9c64 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:26.094001 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4a55ca61-14c9-4c8a-b09d-cb1b0eea9c64 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:26.095063 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4a55ca61-14c9-4c8a-b09d-cb1b0eea9c64 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:26.095716 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4a55ca61-14c9-4c8a-b09d-cb1b0eea9c64 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:26.178786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4cc6016a-9129-4a1e-a194-8d1c9f4b9717 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:26.187704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4cc6016a-9129-4a1e-a194-8d1c9f4b9717 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1314 microversion: 2.1 time: 0.188523 Jul 12 03:51:26.189356 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 141/270] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:25 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:26.321145 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4a55ca61-14c9-4c8a-b09d-cb1b0eea9c64 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:26.334980 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4a55ca61-14c9-4c8a-b09d-cb1b0eea9c64 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.267030 Jul 12 03:51:26.335749 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 130/271] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:26 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:27.205132 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7918238f-0175-459b-93b5-8fd4268c4080 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:27.206509 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7918238f-0175-459b-93b5-8fd4268c4080 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:27.217246 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7918238f-0175-459b-93b5-8fd4268c4080 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:27.220260 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7918238f-0175-459b-93b5-8fd4268c4080 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:27.221248 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7918238f-0175-459b-93b5-8fd4268c4080 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:27.223625 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7918238f-0175-459b-93b5-8fd4268c4080 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:27.353411 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-dc9bb72b-e45a-4734-b3d2-2ce4ff4bc29e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:27.354035 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-dc9bb72b-e45a-4734-b3d2-2ce4ff4bc29e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:27.365287 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dc9bb72b-e45a-4734-b3d2-2ce4ff4bc29e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:27.365747 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dc9bb72b-e45a-4734-b3d2-2ce4ff4bc29e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:27.368792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dc9bb72b-e45a-4734-b3d2-2ce4ff4bc29e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:27.369362 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dc9bb72b-e45a-4734-b3d2-2ce4ff4bc29e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:27.528578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7918238f-0175-459b-93b5-8fd4268c4080 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:27.544693 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7918238f-0175-459b-93b5-8fd4268c4080 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1314 microversion: 2.1 time: 0.343264 Jul 12 03:51:27.545288 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 142/272] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:27 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:27.671356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-dc9bb72b-e45a-4734-b3d2-2ce4ff4bc29e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:27.695672 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-dc9bb72b-e45a-4734-b3d2-2ce4ff4bc29e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.345667 Jul 12 03:51:27.697146 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 131/273] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:27 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:28.511807 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-ea38677c-53cc-4605-a04f-f9c47a4c24f1 req-01423b1f-f226-4c72-a983-850a23840c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed319c48-b1ca-431c-b513-311df9d609aa", "name": "network-vif-plugged", "status": "completed", "tag": "f6ccf5de-bcd7-4b16-8490-ab42e8fbffb3"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:28.521728 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-ea38677c-53cc-4605-a04f-f9c47a4c24f1 req-01423b1f-f226-4c72-a983-850a23840c9b service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:28.522448 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-ea38677c-53cc-4605-a04f-f9c47a4c24f1 req-01423b1f-f226-4c72-a983-850a23840c9b service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:28.564868 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3ab15623-b8d2-47ca-afe6-4520fadb124a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:28.565499 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3ab15623-b8d2-47ca-afe6-4520fadb124a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:28.578077 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3ab15623-b8d2-47ca-afe6-4520fadb124a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:28.579311 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3ab15623-b8d2-47ca-afe6-4520fadb124a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:28.582347 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3ab15623-b8d2-47ca-afe6-4520fadb124a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:28.585552 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3ab15623-b8d2-47ca-afe6-4520fadb124a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:28.726227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-ea38677c-53cc-4605-a04f-f9c47a4c24f1 req-01423b1f-f226-4c72-a983-850a23840c9b service nova] Creating event network-vif-plugged:f6ccf5de-bcd7-4b16-8490-ab42e8fbffb3 for instance ed319c48-b1ca-431c-b513-311df9d609aa on hv-cinder-84773 Jul 12 03:51:28.732051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-ea38677c-53cc-4605-a04f-f9c47a4c24f1 req-01423b1f-f226-4c72-a983-850a23840c9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223772 Jul 12 03:51:28.732986 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 143/274] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:51:28.739874 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-78826ba6-861c-4f7a-bf21-c1b96a0663bc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:28.740857 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-78826ba6-861c-4f7a-bf21-c1b96a0663bc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:28.748641 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78826ba6-861c-4f7a-bf21-c1b96a0663bc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:28.749173 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78826ba6-861c-4f7a-bf21-c1b96a0663bc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:28.749971 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78826ba6-861c-4f7a-bf21-c1b96a0663bc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:28.750461 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78826ba6-861c-4f7a-bf21-c1b96a0663bc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:29.042293 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3ab15623-b8d2-47ca-afe6-4520fadb124a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:29.054352 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3ab15623-b8d2-47ca-afe6-4520fadb124a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1314 microversion: 2.1 time: 0.492820 Jul 12 03:51:29.055526 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 132/275] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:28 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:29.110856 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-78826ba6-861c-4f7a-bf21-c1b96a0663bc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:29.125678 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-78826ba6-861c-4f7a-bf21-c1b96a0663bc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.390799 Jul 12 03:51:29.126856 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 144/276] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:28 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:30.072385 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-aa7cfef4-dcc7-4ce7-884f-4b363e3e3082 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:30.072997 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-aa7cfef4-dcc7-4ce7-884f-4b363e3e3082 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:30.082902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-aa7cfef4-dcc7-4ce7-884f-4b363e3e3082 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:30.083359 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-aa7cfef4-dcc7-4ce7-884f-4b363e3e3082 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:30.084498 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-aa7cfef4-dcc7-4ce7-884f-4b363e3e3082 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:30.084958 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-aa7cfef4-dcc7-4ce7-884f-4b363e3e3082 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:30.143574 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cac1317b-58ea-4b36-80d7-8b6434221377 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:30.144417 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-cac1317b-58ea-4b36-80d7-8b6434221377 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:30.156555 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cac1317b-58ea-4b36-80d7-8b6434221377 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:30.157017 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cac1317b-58ea-4b36-80d7-8b6434221377 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:30.157820 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cac1317b-58ea-4b36-80d7-8b6434221377 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:30.158266 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cac1317b-58ea-4b36-80d7-8b6434221377 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:30.251538 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-aa7cfef4-dcc7-4ce7-884f-4b363e3e3082 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:30.268346 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-aa7cfef4-dcc7-4ce7-884f-4b363e3e3082 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1314 microversion: 2.1 time: 0.199980 Jul 12 03:51:30.269272 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 133/277] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:30 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:30.442283 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cac1317b-58ea-4b36-80d7-8b6434221377 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:30.455474 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cac1317b-58ea-4b36-80d7-8b6434221377 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.316598 Jul 12 03:51:30.467062 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 145/278] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:30 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:31.287016 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-78af618d-d1e0-49c2-b10a-bafe0347ec13 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:31.288418 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-78af618d-d1e0-49c2-b10a-bafe0347ec13 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:31.300801 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-78af618d-d1e0-49c2-b10a-bafe0347ec13 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:31.301254 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-78af618d-d1e0-49c2-b10a-bafe0347ec13 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:31.304119 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-78af618d-d1e0-49c2-b10a-bafe0347ec13 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:31.305116 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-78af618d-d1e0-49c2-b10a-bafe0347ec13 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:31.474877 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0217d0c3-d06e-48d3-b8d1-e283b0cf57d7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:31.476116 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0217d0c3-d06e-48d3-b8d1-e283b0cf57d7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:31.489079 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0217d0c3-d06e-48d3-b8d1-e283b0cf57d7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:31.491515 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0217d0c3-d06e-48d3-b8d1-e283b0cf57d7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:31.492499 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0217d0c3-d06e-48d3-b8d1-e283b0cf57d7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:31.495032 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0217d0c3-d06e-48d3-b8d1-e283b0cf57d7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:31.569071 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:31.604905 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-78af618d-d1e0-49c2-b10a-bafe0347ec13 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:31.613204 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-78af618d-d1e0-49c2-b10a-bafe0347ec13 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1314 microversion: 2.1 time: 0.331458 Jul 12 03:51:31.614805 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 134/279] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:31 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:32.033741 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0217d0c3-d06e-48d3-b8d1-e283b0cf57d7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:32.042287 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0217d0c3-d06e-48d3-b8d1-e283b0cf57d7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1500 microversion: 2.1 time: 0.573487 Jul 12 03:51:32.042871 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 146/280] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:31 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1500 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:32.061670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-57feb15e-a246-49d0-852d-9e5570ba734f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65923686-11eb-4c48-a4fd-cb8f85c374d1"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:32.063868 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-57feb15e-a246-49d0-852d-9e5570ba734f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:32.083203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-57feb15e-a246-49d0-852d-9e5570ba734f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:32.083886 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-57feb15e-a246-49d0-852d-9e5570ba734f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:32.084889 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-57feb15e-a246-49d0-852d-9e5570ba734f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:32.085340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-57feb15e-a246-49d0-852d-9e5570ba734f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:32.115623 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-57feb15e-a246-49d0-852d-9e5570ba734f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] HTTP exception thrown: Cannot 'attach_volume' instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d while it is in vm_state rescued Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-57feb15e-a246-49d0-852d-9e5570ba734f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Request method failure captured: Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: POST /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d/os-volume_attachments HTTP/1.1 Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 74 Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO85KuFNBV6-7fhbKmf1HpN6NpFGL5F9bcT48Xy246CyrY1X-tZ6u1_GDiVEEcEOXK-36PJ2uqiZHJaN-K6sZMfqj7MllOAmWZRTHd3ToaqY0XJtpityteYLeRZ64xutpJXSWrWjQe5b6KmzxNtSsfX6_4rSQHrXOiL1YcZZVJ6djNA Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: fd03cff94a1842d8811deafa0dce10f9 Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:51:32.117643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:51:32.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd03cff94a1842d8811deafa0dce10f9"}]}] Jul 12 03:51:32.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:51:32.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: fd03cff94a1842d8811deafa0dce10f9 Jul 12 03:51:32.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:51:32.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-ServerRescueNegativeTestJSON-1509525019-project Jul 12 03:51:32.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:51:32.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:51:32.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 4ac2825db0c649cab6dcc2e27fbaf80d Jul 12 03:51:32.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1509525019-project Jul 12 03:51:32.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Jul 12 03:51:32.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {"volumeAttachment": {"volumeId": "65923686-11eb-4c48-a4fd-cb8f85c374d1"}} Jul 12 03:51:32.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Cannot 'attach_volume' instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d while it is in vm_state rescued Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'server_id': '48f1cbdb-c631-4f89-b3c5-8e74819e942d', 'body': {'volumeAttachment': {'volumeId': '65923686-11eb-4c48-a4fd-cb8f85c374d1'}}} Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:51:32.119702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d while it is in vm_state rescued Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:51:32.121050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:51:32.122377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:51:32.122377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:51:32.122377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d while it is in vm_state rescued Jul 12 03:51:32.122377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:51:32.123900 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-57feb15e-a246-49d0-852d-9e5570ba734f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Returning 409 to user: Cannot 'attach_volume' instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d while it is in vm_state rescued {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:51:32.124791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-57feb15e-a246-49d0-852d-9e5570ba734f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "POST /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067993 Jul 12 03:51:32.125731 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 135/281] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 03:51:32 2022] POST /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 03:51:32.137969 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-521203f0-71b2-4008-899c-0b26bd35ade2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:32.138665 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-521203f0-71b2-4008-899c-0b26bd35ade2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:32.145966 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-521203f0-71b2-4008-899c-0b26bd35ade2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:32.146563 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-521203f0-71b2-4008-899c-0b26bd35ade2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:32.147597 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-521203f0-71b2-4008-899c-0b26bd35ade2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:32.148153 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-521203f0-71b2-4008-899c-0b26bd35ade2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:32.224239 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-521203f0-71b2-4008-899c-0b26bd35ade2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "POST /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d/action" status: 202 len: 0 microversion: 2.1 time: 0.090308 Jul 12 03:51:32.225617 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 147/282] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 03:51:32 2022] POST /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 03:51:32.233640 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-35a83a27-e47c-4767-b1c5-64628711f08d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:32.234254 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-35a83a27-e47c-4767-b1c5-64628711f08d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:32.240960 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-35a83a27-e47c-4767-b1c5-64628711f08d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:32.241406 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-35a83a27-e47c-4767-b1c5-64628711f08d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:32.242931 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-35a83a27-e47c-4767-b1c5-64628711f08d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:32.242931 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-35a83a27-e47c-4767-b1c5-64628711f08d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:32.453299 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-35a83a27-e47c-4767-b1c5-64628711f08d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:32.463697 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-35a83a27-e47c-4767-b1c5-64628711f08d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1508 microversion: 2.1 time: 0.234276 Jul 12 03:51:32.464345 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 136/283] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:32 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:32.564806 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-650fc51b-da22-442e-a78c-42ed49101658 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Action: 'create', calling method: .version_select at 0x7fd7fa95ed30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-359074052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaxZnU4IfiV3rKxHJ1C3+k6V8Q77iL4NmpSIsP+9FZObl7SJiwcdpvpVeULjq/BiynI5Kqmuy3PKLrQyZjZFT4nPjGlYizdH7lMtcICUYZYviAWGyASix84xwvi5yK2uw=="}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:32.579608 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-650fc51b-da22-442e-a78c-42ed49101658 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Getting quotas for project 99d9e85c63234c77889f856bf95288f5. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:51:32.583648 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-650fc51b-da22-442e-a78c-42ed49101658 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Getting quotas for user 46d5c3f98d924538a34c4b3a57fcac14 and project 99d9e85c63234c77889f856bf95288f5. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:51:32.607258 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-650fc51b-da22-442e-a78c-42ed49101658 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.261014 Jul 12 03:51:32.607850 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 148/284] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 03:51:32 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:51:32.631410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4f422f98-29e9-45f4-9b7b-5f6526228b3b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:32.632039 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4f422f98-29e9-45f4-9b7b-5f6526228b3b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:32.639478 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4f422f98-29e9-45f4-9b7b-5f6526228b3b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:32.645269 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4f422f98-29e9-45f4-9b7b-5f6526228b3b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:32.646257 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4f422f98-29e9-45f4-9b7b-5f6526228b3b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:32.646794 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4f422f98-29e9-45f4-9b7b-5f6526228b3b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:32.856656 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4f422f98-29e9-45f4-9b7b-5f6526228b3b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:32.864874 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4f422f98-29e9-45f4-9b7b-5f6526228b3b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1498 microversion: 2.1 time: 0.237647 Jul 12 03:51:32.865715 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 137/285] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:32 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1498 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:33.480537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-335964e1-914f-46f5-8391-721c3c4d1653 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:33.481263 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-335964e1-914f-46f5-8391-721c3c4d1653 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:33.492708 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-335964e1-914f-46f5-8391-721c3c4d1653 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:33.503869 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-335964e1-914f-46f5-8391-721c3c4d1653 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:33.505088 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-335964e1-914f-46f5-8391-721c3c4d1653 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:33.505670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-335964e1-914f-46f5-8391-721c3c4d1653 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:33.729317 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-335964e1-914f-46f5-8391-721c3c4d1653 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:33.739579 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-335964e1-914f-46f5-8391-721c3c4d1653 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1508 microversion: 2.1 time: 0.262940 Jul 12 03:51:33.750595 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 149/286] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:33 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:34.337861 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c1784178-eaa7-415a-9338-aceb81058424 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:34.338894 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c1784178-eaa7-415a-9338-aceb81058424 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:34.345588 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c1784178-eaa7-415a-9338-aceb81058424 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:34.346208 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c1784178-eaa7-415a-9338-aceb81058424 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:34.347614 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c1784178-eaa7-415a-9338-aceb81058424 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:34.348235 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c1784178-eaa7-415a-9338-aceb81058424 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:34.371378 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-249969741", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "networks": [{"uuid": "a69bab14-5f26-41ea-927b-f205133d3d80"}]}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:34.379573 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=100 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:34.387595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c1784178-eaa7-415a-9338-aceb81058424 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:51:34.426325 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.network.neutron [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] validate_networks() for [('a69bab14-5f26-41ea-927b-f205133d3d80', None, None, None, None, None)] {{(pid=124434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:51:34.473178 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c1784178-eaa7-415a-9338-aceb81058424 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 204 len: 0 microversion: 2.1 time: 0.141432 Jul 12 03:51:34.473762 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 138/287] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:51:34 2022] DELETE /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:51:34.482084 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-09bcd901-74f3-4032-ada5-3d7106e218c7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:34.482767 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-09bcd901-74f3-4032-ada5-3d7106e218c7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:34.488610 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-09bcd901-74f3-4032-ada5-3d7106e218c7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:34.489046 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-09bcd901-74f3-4032-ada5-3d7106e218c7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:34.489795 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-09bcd901-74f3-4032-ada5-3d7106e218c7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:34.490216 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-09bcd901-74f3-4032-ada5-3d7106e218c7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:34.642663 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-09bcd901-74f3-4032-ada5-3d7106e218c7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:34.651651 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-09bcd901-74f3-4032-ada5-3d7106e218c7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1504 microversion: 2.1 time: 0.173190 Jul 12 03:51:34.661404 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 139/288] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:34 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:34.758354 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-11935442-b4a4-4f0f-8449-c604d74da010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:34.758960 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-11935442-b4a4-4f0f-8449-c604d74da010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:34.765064 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11935442-b4a4-4f0f-8449-c604d74da010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:34.765507 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11935442-b4a4-4f0f-8449-c604d74da010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:34.766266 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11935442-b4a4-4f0f-8449-c604d74da010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:34.766692 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11935442-b4a4-4f0f-8449-c604d74da010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:34.824418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Flavor limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:51:34.824945 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Image limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:51:34.825557 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Flavor pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:51:34.828240 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Image pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:51:34.828786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:51:34.838598 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:34.839146 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:34.839942 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:34.840407 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:34.860940 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Getting quotas for project cd2e5f7d1e2e4aa3a98bbbf89a6ec276. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:51:34.866028 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Getting quotas for user 9e27cbb381174481ade02b228faa8fb8 and project cd2e5f7d1e2e4aa3a98bbbf89a6ec276. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:51:34.879097 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Going to run 1 instances... {{(pid=124434) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:51:34.881620 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:51:34.917833 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-11935442-b4a4-4f0f-8449-c604d74da010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:34.925711 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-11935442-b4a4-4f0f-8449-c604d74da010 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1508 microversion: 2.1 time: 0.171918 Jul 12 03:51:34.926468 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 140/289] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:34 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:34.936444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ef860809-b355-4c52-a304-889c2d32cf05 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568871 Jul 12 03:51:34.937291 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 150/290] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 03:51:34.947416 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3f2dd0f2-34a1-4463-96ca-5f5e19865c91 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:34.948349 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3f2dd0f2-34a1-4463-96ca-5f5e19865c91 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:35.008812 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3f2dd0f2-34a1-4463-96ca-5f5e19865c91 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:35.015946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3f2dd0f2-34a1-4463-96ca-5f5e19865c91 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1218 microversion: 2.1 time: 0.072441 Jul 12 03:51:35.016722 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 141/291] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:34 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:35.669816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d0546842-802e-4d5a-8ebd-3ef54ab5a486 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:35.670530 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d0546842-802e-4d5a-8ebd-3ef54ab5a486 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:35.676974 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d0546842-802e-4d5a-8ebd-3ef54ab5a486 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:35.677446 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d0546842-802e-4d5a-8ebd-3ef54ab5a486 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:35.678201 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d0546842-802e-4d5a-8ebd-3ef54ab5a486 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:35.678692 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d0546842-802e-4d5a-8ebd-3ef54ab5a486 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:35.819150 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d0546842-802e-4d5a-8ebd-3ef54ab5a486 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:35.827001 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d0546842-802e-4d5a-8ebd-3ef54ab5a486 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1504 microversion: 2.1 time: 0.161770 Jul 12 03:51:35.827593 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 151/292] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:35 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:35.944730 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-aa7c5886-811a-4b51-b5e4-173e13b5e56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:35.945430 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-aa7c5886-811a-4b51-b5e4-173e13b5e56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:35.952345 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-aa7c5886-811a-4b51-b5e4-173e13b5e56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:35.952871 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-aa7c5886-811a-4b51-b5e4-173e13b5e56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:35.953693 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-aa7c5886-811a-4b51-b5e4-173e13b5e56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:35.954225 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-aa7c5886-811a-4b51-b5e4-173e13b5e56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:36.034134 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-93e38b91-8d93-4dd7-8c82-16446e512264 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:36.034749 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-93e38b91-8d93-4dd7-8c82-16446e512264 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:36.044292 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-93e38b91-8d93-4dd7-8c82-16446e512264 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:36.044292 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-93e38b91-8d93-4dd7-8c82-16446e512264 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:36.044292 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-93e38b91-8d93-4dd7-8c82-16446e512264 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:36.044545 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-93e38b91-8d93-4dd7-8c82-16446e512264 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:36.101553 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-aa7c5886-811a-4b51-b5e4-173e13b5e56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:36.109434 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-aa7c5886-811a-4b51-b5e4-173e13b5e56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1508 microversion: 2.1 time: 0.168596 Jul 12 03:51:36.110009 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 142/293] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:35 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:36.114528 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-93e38b91-8d93-4dd7-8c82-16446e512264 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:36.122124 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-93e38b91-8d93-4dd7-8c82-16446e512264 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1222 microversion: 2.1 time: 0.092187 Jul 12 03:51:36.122773 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 152/294] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:36 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:36.844181 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d0fbccd1-9237-4dff-9272-31c24e0922b2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:36.844907 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d0fbccd1-9237-4dff-9272-31c24e0922b2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:36.850885 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d0fbccd1-9237-4dff-9272-31c24e0922b2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:36.851315 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d0fbccd1-9237-4dff-9272-31c24e0922b2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:36.852085 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d0fbccd1-9237-4dff-9272-31c24e0922b2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:36.852507 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d0fbccd1-9237-4dff-9272-31c24e0922b2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:37.008357 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d0fbccd1-9237-4dff-9272-31c24e0922b2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:37.016201 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d0fbccd1-9237-4dff-9272-31c24e0922b2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1504 microversion: 2.1 time: 0.175953 Jul 12 03:51:37.016783 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 143/295] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:36 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:37.126997 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-869b64ac-2b88-4f1a-b5eb-7d688f666669 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:37.127674 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-869b64ac-2b88-4f1a-b5eb-7d688f666669 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:37.140121 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-233ae7ec-2aa1-48c1-8cfb-6e90b299076f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:37.141124 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-233ae7ec-2aa1-48c1-8cfb-6e90b299076f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:37.146703 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-869b64ac-2b88-4f1a-b5eb-7d688f666669 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:37.147136 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-869b64ac-2b88-4f1a-b5eb-7d688f666669 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:37.151039 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-233ae7ec-2aa1-48c1-8cfb-6e90b299076f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:37.151487 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-233ae7ec-2aa1-48c1-8cfb-6e90b299076f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:37.153568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-869b64ac-2b88-4f1a-b5eb-7d688f666669 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:37.154186 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-869b64ac-2b88-4f1a-b5eb-7d688f666669 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:37.159307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-233ae7ec-2aa1-48c1-8cfb-6e90b299076f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:37.164897 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-233ae7ec-2aa1-48c1-8cfb-6e90b299076f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:37.237928 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-233ae7ec-2aa1-48c1-8cfb-6e90b299076f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:37.249572 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-233ae7ec-2aa1-48c1-8cfb-6e90b299076f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1222 microversion: 2.1 time: 0.114500 Jul 12 03:51:37.250728 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 144/296] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:37 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:37.315408 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-869b64ac-2b88-4f1a-b5eb-7d688f666669 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:37.323154 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-869b64ac-2b88-4f1a-b5eb-7d688f666669 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1508 microversion: 2.1 time: 0.200169 Jul 12 03:51:37.323732 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 153/297] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:37 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:38.037849 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a22eb498-ed7d-4147-9eee-ec3666a7b1d4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:38.038840 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a22eb498-ed7d-4147-9eee-ec3666a7b1d4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:38.042175 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:38.049532 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a22eb498-ed7d-4147-9eee-ec3666a7b1d4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:38.049977 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a22eb498-ed7d-4147-9eee-ec3666a7b1d4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:38.050752 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a22eb498-ed7d-4147-9eee-ec3666a7b1d4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:38.051185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a22eb498-ed7d-4147-9eee-ec3666a7b1d4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:38.188906 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a22eb498-ed7d-4147-9eee-ec3666a7b1d4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:38.197303 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a22eb498-ed7d-4147-9eee-ec3666a7b1d4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1504 microversion: 2.1 time: 0.165898 Jul 12 03:51:38.197871 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 145/298] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:38 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:38.273290 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-27c37aab-5f60-4606-b080-23d5af3fefaf tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:38.274367 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-27c37aab-5f60-4606-b080-23d5af3fefaf tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:38.284036 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-27c37aab-5f60-4606-b080-23d5af3fefaf tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:38.284507 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-27c37aab-5f60-4606-b080-23d5af3fefaf tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:38.285287 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-27c37aab-5f60-4606-b080-23d5af3fefaf tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:38.285719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-27c37aab-5f60-4606-b080-23d5af3fefaf tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:38.342148 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e10f8016-d4ae-480d-b163-3d830239f0c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:38.342948 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e10f8016-d4ae-480d-b163-3d830239f0c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:38.350219 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-27c37aab-5f60-4606-b080-23d5af3fefaf tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:38.351234 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e10f8016-d4ae-480d-b163-3d830239f0c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:38.351675 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e10f8016-d4ae-480d-b163-3d830239f0c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:38.352498 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e10f8016-d4ae-480d-b163-3d830239f0c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:38.352920 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e10f8016-d4ae-480d-b163-3d830239f0c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:38.357864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-27c37aab-5f60-4606-b080-23d5af3fefaf tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1222 microversion: 2.1 time: 0.093348 Jul 12 03:51:38.358431 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 154/299] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:38 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:38.484770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e10f8016-d4ae-480d-b163-3d830239f0c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:38.494742 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e10f8016-d4ae-480d-b163-3d830239f0c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1508 microversion: 2.1 time: 0.157045 Jul 12 03:51:38.495431 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 146/300] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:38 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:39.215135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-da5fdf6e-99b7-44ea-82b8-9439342d778a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:39.215647 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-da5fdf6e-99b7-44ea-82b8-9439342d778a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:39.222140 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da5fdf6e-99b7-44ea-82b8-9439342d778a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:39.222585 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da5fdf6e-99b7-44ea-82b8-9439342d778a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:39.223346 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da5fdf6e-99b7-44ea-82b8-9439342d778a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:39.223776 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da5fdf6e-99b7-44ea-82b8-9439342d778a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:39.358886 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-da5fdf6e-99b7-44ea-82b8-9439342d778a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:39.366225 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-da5fdf6e-99b7-44ea-82b8-9439342d778a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1504 microversion: 2.1 time: 0.155009 Jul 12 03:51:39.367174 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 155/301] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:39 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:39.381402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8263b146-bd02-4d74-a986-9cabcf1be1b1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:39.382009 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8263b146-bd02-4d74-a986-9cabcf1be1b1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:39.388157 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8263b146-bd02-4d74-a986-9cabcf1be1b1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:39.388604 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8263b146-bd02-4d74-a986-9cabcf1be1b1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:39.389454 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8263b146-bd02-4d74-a986-9cabcf1be1b1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:39.389889 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8263b146-bd02-4d74-a986-9cabcf1be1b1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:39.455941 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8263b146-bd02-4d74-a986-9cabcf1be1b1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:39.463610 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8263b146-bd02-4d74-a986-9cabcf1be1b1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1270 microversion: 2.1 time: 0.086064 Jul 12 03:51:39.464202 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 147/302] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:39 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:39.512676 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d4192d91-677d-4560-ae4b-7d0b2dd0b4ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:39.513462 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d4192d91-677d-4560-ae4b-7d0b2dd0b4ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:39.520281 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d4192d91-677d-4560-ae4b-7d0b2dd0b4ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:39.520711 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d4192d91-677d-4560-ae4b-7d0b2dd0b4ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:39.521488 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d4192d91-677d-4560-ae4b-7d0b2dd0b4ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:39.522087 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d4192d91-677d-4560-ae4b-7d0b2dd0b4ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:39.661258 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d4192d91-677d-4560-ae4b-7d0b2dd0b4ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:39.669153 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d4192d91-677d-4560-ae4b-7d0b2dd0b4ee tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1514 microversion: 2.1 time: 0.160433 Jul 12 03:51:39.669723 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 156/303] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:39 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:40.383407 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fec407d2-ff94-4be2-900c-ac56e46a3e8f tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:40.384309 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-fec407d2-ff94-4be2-900c-ac56e46a3e8f tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:40.390855 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fec407d2-ff94-4be2-900c-ac56e46a3e8f tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:40.391531 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fec407d2-ff94-4be2-900c-ac56e46a3e8f tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:40.392691 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fec407d2-ff94-4be2-900c-ac56e46a3e8f tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:40.393131 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fec407d2-ff94-4be2-900c-ac56e46a3e8f tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:40.482016 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a3e91c47-31c4-4644-84a9-3a8dccefed45 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:40.482634 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a3e91c47-31c4-4644-84a9-3a8dccefed45 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:40.489480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a3e91c47-31c4-4644-84a9-3a8dccefed45 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:40.489970 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a3e91c47-31c4-4644-84a9-3a8dccefed45 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:40.490732 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a3e91c47-31c4-4644-84a9-3a8dccefed45 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:40.491231 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a3e91c47-31c4-4644-84a9-3a8dccefed45 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:40.560914 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a3e91c47-31c4-4644-84a9-3a8dccefed45 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:40.572471 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a3e91c47-31c4-4644-84a9-3a8dccefed45 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1288 microversion: 2.1 time: 0.095036 Jul 12 03:51:40.583755 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 157/304] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:40 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:40.679270 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-fec407d2-ff94-4be2-900c-ac56e46a3e8f tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:40.696276 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-fec407d2-ff94-4be2-900c-ac56e46a3e8f tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1504 microversion: 2.1 time: 0.316045 Jul 12 03:51:40.696981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 148/305] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:40 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:41.095984 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-f711f941-6163-405e-b68e-bdd2b3009f25 req-a53c4b25-d596-45c0-8843-3b83a52969e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed319c48-b1ca-431c-b513-311df9d609aa", "name": "network-vif-deleted", "tag": "f6ccf5de-bcd7-4b16-8490-ab42e8fbffb3"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:41.105227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-f711f941-6163-405e-b68e-bdd2b3009f25 req-a53c4b25-d596-45c0-8843-3b83a52969e4 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:41.105861 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-f711f941-6163-405e-b68e-bdd2b3009f25 req-a53c4b25-d596-45c0-8843-3b83a52969e4 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:41.119446 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-f711f941-6163-405e-b68e-bdd2b3009f25 req-a53c4b25-d596-45c0-8843-3b83a52969e4 service nova] Creating event network-vif-deleted:f6ccf5de-bcd7-4b16-8490-ab42e8fbffb3 for instance ed319c48-b1ca-431c-b513-311df9d609aa on hv-cinder-84773 Jul 12 03:51:41.127669 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-f711f941-6163-405e-b68e-bdd2b3009f25 req-a53c4b25-d596-45c0-8843-3b83a52969e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035398 Jul 12 03:51:41.129028 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 158/306] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:51:41.591130 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-099234f0-b14e-426c-8905-dfd798906aae tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:41.591784 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-099234f0-b14e-426c-8905-dfd798906aae tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:41.598683 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-099234f0-b14e-426c-8905-dfd798906aae tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:41.599143 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-099234f0-b14e-426c-8905-dfd798906aae tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:41.599918 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-099234f0-b14e-426c-8905-dfd798906aae tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:41.600374 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-099234f0-b14e-426c-8905-dfd798906aae tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:41.721221 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b80b6913-e7ee-4028-95da-48a5a554ba6b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:41.722313 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b80b6913-e7ee-4028-95da-48a5a554ba6b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:41.739131 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b80b6913-e7ee-4028-95da-48a5a554ba6b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:41.739519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b80b6913-e7ee-4028-95da-48a5a554ba6b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:41.740366 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b80b6913-e7ee-4028-95da-48a5a554ba6b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:41.740807 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b80b6913-e7ee-4028-95da-48a5a554ba6b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:41.793962 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b80b6913-e7ee-4028-95da-48a5a554ba6b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:41.810697 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-099234f0-b14e-426c-8905-dfd798906aae tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:41.821399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b80b6913-e7ee-4028-95da-48a5a554ba6b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:41.822094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-b80b6913-e7ee-4028-95da-48a5a554ba6b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lazy-loading 'fault' on Instance uuid ed319c48-b1ca-431c-b513-311df9d609aa {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:51:41.826886 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-099234f0-b14e-426c-8905-dfd798906aae tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.239654 Jul 12 03:51:41.835114 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 149/307] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:41 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:41.901324 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b80b6913-e7ee-4028-95da-48a5a554ba6b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:41.909053 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b80b6913-e7ee-4028-95da-48a5a554ba6b tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 200 len: 1304 microversion: 2.1 time: 0.199207 Jul 12 03:51:41.909704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 159/308] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:41 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 1304 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:42.090543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-62ee59fe-d918-4bf8-857f-5591bfe0a9f3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Action: 'create', calling method: .version_select at 0x7fd7faec8790>, body: {"keypair": {"name": "tempest-keypair-1356440648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7YJs/f1YUcmMK4/qU6V47FoJmB/ZQ837UFzLa0XlnOOATU//lsaWMaHdR9gbr2UJ13uzz3jVatcEhHnzvSgxHdLVHDXlCjaoAs7lCzay+BvHp4sZF0nnT7KMnIxYDeqA=="}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:42.105412 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-62ee59fe-d918-4bf8-857f-5591bfe0a9f3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Getting quotas for project fd03cff94a1842d8811deafa0dce10f9. Resources: {'key_pairs'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:51:42.110334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-62ee59fe-d918-4bf8-857f-5591bfe0a9f3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Getting quotas for user 4ac2825db0c649cab6dcc2e27fbaf80d and project fd03cff94a1842d8811deafa0dce10f9. Resources: {'key_pairs'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:51:42.135550 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-62ee59fe-d918-4bf8-857f-5591bfe0a9f3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048982 Jul 12 03:51:42.136614 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 150/309] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 03:51:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:51:42.851331 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4bd40ec8-f4e0-4ca6-b9fe-d3894308c661 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:42.851874 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4bd40ec8-f4e0-4ca6-b9fe-d3894308c661 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:42.858241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4bd40ec8-f4e0-4ca6-b9fe-d3894308c661 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:42.858723 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4bd40ec8-f4e0-4ca6-b9fe-d3894308c661 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:42.859492 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4bd40ec8-f4e0-4ca6-b9fe-d3894308c661 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:42.859971 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4bd40ec8-f4e0-4ca6-b9fe-d3894308c661 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:42.926878 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-04ab349f-fb82-47bb-934f-adc92c4efb3e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:42.928277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-04ab349f-fb82-47bb-934f-adc92c4efb3e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: ed319c48-b1ca-431c-b513-311df9d609aa] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:42.938888 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-04ab349f-fb82-47bb-934f-adc92c4efb3e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:42.939567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-04ab349f-fb82-47bb-934f-adc92c4efb3e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:42.940556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-04ab349f-fb82-47bb-934f-adc92c4efb3e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:42.941227 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-04ab349f-fb82-47bb-934f-adc92c4efb3e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:42.959076 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-04ab349f-fb82-47bb-934f-adc92c4efb3e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] HTTP exception thrown: Instance ed319c48-b1ca-431c-b513-311df9d609aa could not be found. Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-04ab349f-fb82-47bb-934f-adc92c4efb3e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Request method failure captured: Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa HTTP/1.1 Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO-vEVHHQtT-5UiS36E8kMv7P5kEH9zIrAmKdTKKq8xg8hlm7uRH_ncdJJ4PU3aUrqYIrZWDiZ91dlzUNRQS2XR1qjUiWIKqqFMPbYL0Qn9bWM7pHVLVryeE7QRdifLl2Vy5n4Gf_WPVvOl2yANBo78toRKPi-H0w3_pLZ9rRKREgBU Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 3e33bfd157c64f8688b9720d80a3a8af Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-VolumesActionsTest-1789779712 Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:51:42.959915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:51:42.961497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e33bfd157c64f8688b9720d80a3a8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e33bfd157c64f8688b9720d80a3a8af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e33bfd157c64f8688b9720d80a3a8af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e33bfd157c64f8688b9720d80a3a8af"}]}] Jul 12 03:51:42.961497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-VolumesActionsTest-1789779712 Jul 12 03:51:42.961497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 3e33bfd157c64f8688b9720d80a3a8af Jul 12 03:51:42.961497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-VolumesActionsTest-1789779712 Jul 12 03:51:42.961497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-VolumesActionsTest-1789779712-project Jul 12 03:51:42.961497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:51:42.961497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:51:42.961497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 2ea01587de8f4d5584d1b12ef042d421 Jul 12 03:51:42.961497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-VolumesActionsTest-1789779712-project Jul 12 03:51:42.961497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 03:51:42.961497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance ed319c48-b1ca-431c-b513-311df9d609aa could not be found. Jul 12 03:51:42.961497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'ed319c48-b1ca-431c-b513-311df9d609aa'} Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed319c48-b1ca-431c-b513-311df9d609aa could not be found. Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:51:42.962342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed319c48-b1ca-431c-b513-311df9d609aa could not be found. Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed319c48-b1ca-431c-b513-311df9d609aa could not be found. Jul 12 03:51:42.963706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:51:42.965040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-04ab349f-fb82-47bb-934f-adc92c4efb3e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Returning 404 to user: Instance ed319c48-b1ca-431c-b513-311df9d609aa could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:51:42.966153 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-04ab349f-fb82-47bb-934f-adc92c4efb3e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa" status: 404 len: 111 microversion: 2.1 time: 0.043347 Jul 12 03:51:42.971050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 151/310] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:42 2022] GET /compute/v2.1/servers/ed319c48-b1ca-431c-b513-311df9d609aa => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:51:43.123462 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1397320316", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "networks": [{"uuid": "1fbf7062-dd80-4df4-aff2-3f3cec0e4cd4"}]}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:43.175147 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4bd40ec8-f4e0-4ca6-b9fe-d3894308c661 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:43.185550 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4bd40ec8-f4e0-4ca6-b9fe-d3894308c661 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.338314 Jul 12 03:51:43.186717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 160/311] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:42 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:43.189852 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.network.neutron [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] validate_networks() for [('1fbf7062-dd80-4df4-aff2-3f3cec0e4cd4', None, None, None, None, None)] {{(pid=124435) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:51:43.195871 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-ed54f434-f512-4a94-806c-631c4e748652 req-7c3c6266-aff2-4d53-b2ef-a2c1b16315a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "819ccee1-8d15-4186-9538-b903779cdf2f", "tag": "0f893515-f3d7-4404-9069-2651d8e631d6"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:43.207038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-ed54f434-f512-4a94-806c-631c4e748652 req-7c3c6266-aff2-4d53-b2ef-a2c1b16315a6 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:43.207749 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-ed54f434-f512-4a94-806c-631c4e748652 req-7c3c6266-aff2-4d53-b2ef-a2c1b16315a6 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:43.225538 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-ed54f434-f512-4a94-806c-631c4e748652 req-7c3c6266-aff2-4d53-b2ef-a2c1b16315a6 service nova] Creating event network-changed:0f893515-f3d7-4404-9069-2651d8e631d6 for instance 819ccee1-8d15-4186-9538-b903779cdf2f on hv-cinder-84773 Jul 12 03:51:43.232380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-ed54f434-f512-4a94-806c-631c4e748652 req-7c3c6266-aff2-4d53-b2ef-a2c1b16315a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043929 Jul 12 03:51:43.233779 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 161/312] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:51:43.668877 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Flavor limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:51:43.669432 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Image limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:51:43.670134 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Flavor pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:51:43.670809 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Image pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:51:43.671462 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:51:43.680707 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:43.681148 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:43.681936 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:43.682361 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:43.700094 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Getting quotas for project 3e33bfd157c64f8688b9720d80a3a8af. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:51:43.704270 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Getting quotas for user 2ea01587de8f4d5584d1b12ef042d421 and project 3e33bfd157c64f8688b9720d80a3a8af. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:51:43.715561 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Going to run 1 instances... {{(pid=124435) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:51:43.717917 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124435) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:51:43.771235 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a1f0788d-2e8b-482b-8f64-23c305236aa9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652984 Jul 12 03:51:43.772390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 152/313] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:51:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 03:51:43.784299 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2d746857-28fb-4ee0-b5a4-91d6cb92b320 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:43.784299 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2d746857-28fb-4ee0-b5a4-91d6cb92b320 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:43.855324 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-2d746857-28fb-4ee0-b5a4-91d6cb92b320 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:43.864729 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2d746857-28fb-4ee0-b5a4-91d6cb92b320 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1214 microversion: 2.1 time: 0.086085 Jul 12 03:51:43.866837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 162/314] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:43 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:43.911673 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-438616537", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bb25d8f-4fca-43c0-92f4-dd80289def0e"}], "security_groups": [{"name": "tempest-securitygroup--1870633404"}], "key_name": "tempest-keypair-1356440648", "user_data": "}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:44.028588 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.network.neutron [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] validate_networks() for [('8bb25d8f-4fca-43c0-92f4-dd80289def0e', None, None, None, None, None)] {{(pid=124435) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:51:44.203318 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b988c410-14dd-4cc2-8b97-e2c3f283a637 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:44.204435 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b988c410-14dd-4cc2-8b97-e2c3f283a637 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:44.214768 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b988c410-14dd-4cc2-8b97-e2c3f283a637 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:44.215221 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b988c410-14dd-4cc2-8b97-e2c3f283a637 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:44.216138 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b988c410-14dd-4cc2-8b97-e2c3f283a637 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:44.216580 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b988c410-14dd-4cc2-8b97-e2c3f283a637 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:44.354015 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b988c410-14dd-4cc2-8b97-e2c3f283a637 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:44.361713 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b988c410-14dd-4cc2-8b97-e2c3f283a637 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.162701 Jul 12 03:51:44.362583 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 163/315] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:44 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:44.430138 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Flavor limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:51:44.430560 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Image limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:51:44.431119 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Flavor pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:51:44.432124 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Image pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:51:44.432124 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:51:44.442719 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:44.443648 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:44.444810 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:44.445598 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:44.463195 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Getting quotas for project fd03cff94a1842d8811deafa0dce10f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:51:44.467394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Getting quotas for user 4ac2825db0c649cab6dcc2e27fbaf80d and project fd03cff94a1842d8811deafa0dce10f9. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:51:44.479347 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Going to run 1 instances... {{(pid=124435) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:51:44.481615 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124435) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:51:44.530279 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-71db423b-f393-41d7-91cf-46a61b9a0fea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.623401 Jul 12 03:51:44.530930 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 153/316] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:51:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 03:51:44.541078 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8fd465ba-5adc-4e5b-ba3b-78a38ff8d01c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:44.541954 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8fd465ba-5adc-4e5b-ba3b-78a38ff8d01c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:44.543923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:44.605522 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8fd465ba-5adc-4e5b-ba3b-78a38ff8d01c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:44.612857 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8fd465ba-5adc-4e5b-ba3b-78a38ff8d01c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1245 microversion: 2.1 time: 0.075578 Jul 12 03:51:44.613537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 164/317] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:44 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:44.881347 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f9fe9f0d-3226-45f1-ae63-9a7cc0d507b1 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:44.882139 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f9fe9f0d-3226-45f1-ae63-9a7cc0d507b1 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:44.888932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f9fe9f0d-3226-45f1-ae63-9a7cc0d507b1 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:44.889599 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f9fe9f0d-3226-45f1-ae63-9a7cc0d507b1 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:44.890508 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f9fe9f0d-3226-45f1-ae63-9a7cc0d507b1 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:44.891066 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f9fe9f0d-3226-45f1-ae63-9a7cc0d507b1 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:44.970304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f9fe9f0d-3226-45f1-ae63-9a7cc0d507b1 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:44.978120 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f9fe9f0d-3226-45f1-ae63-9a7cc0d507b1 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1218 microversion: 2.1 time: 0.100698 Jul 12 03:51:44.978683 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 154/318] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:44 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:45.382870 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cdc68ac4-b5e8-4963-95fb-95f535e58b47 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:45.383885 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-cdc68ac4-b5e8-4963-95fb-95f535e58b47 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:45.386813 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:45.396575 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cdc68ac4-b5e8-4963-95fb-95f535e58b47 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:45.397032 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cdc68ac4-b5e8-4963-95fb-95f535e58b47 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:45.397819 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cdc68ac4-b5e8-4963-95fb-95f535e58b47 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:45.398270 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cdc68ac4-b5e8-4963-95fb-95f535e58b47 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:45.534748 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cdc68ac4-b5e8-4963-95fb-95f535e58b47 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:45.543955 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cdc68ac4-b5e8-4963-95fb-95f535e58b47 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.167272 Jul 12 03:51:45.544770 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 165/319] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:45 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:45.631461 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2c635811-b75f-4216-b781-2d5d1f2cd690 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:45.632062 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-2c635811-b75f-4216-b781-2d5d1f2cd690 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:45.638720 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2c635811-b75f-4216-b781-2d5d1f2cd690 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:45.639166 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2c635811-b75f-4216-b781-2d5d1f2cd690 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:45.639933 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2c635811-b75f-4216-b781-2d5d1f2cd690 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:45.640405 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2c635811-b75f-4216-b781-2d5d1f2cd690 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:45.702987 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-2c635811-b75f-4216-b781-2d5d1f2cd690 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:45.710767 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-2c635811-b75f-4216-b781-2d5d1f2cd690 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1249 microversion: 2.1 time: 0.083538 Jul 12 03:51:45.711329 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 155/320] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:45 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:45.994821 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5e5820de-6dcd-4155-87d9-f1b20f60f403 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:45.995466 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5e5820de-6dcd-4155-87d9-f1b20f60f403 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:46.001662 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5e5820de-6dcd-4155-87d9-f1b20f60f403 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:46.002113 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5e5820de-6dcd-4155-87d9-f1b20f60f403 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:46.002881 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5e5820de-6dcd-4155-87d9-f1b20f60f403 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:46.003314 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5e5820de-6dcd-4155-87d9-f1b20f60f403 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:46.065491 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5e5820de-6dcd-4155-87d9-f1b20f60f403 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:46.069004 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:46.073856 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5e5820de-6dcd-4155-87d9-f1b20f60f403 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1218 microversion: 2.1 time: 0.082906 Jul 12 03:51:46.074398 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 166/321] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:45 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:46.564928 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a8569a5a-2f55-42de-ab26-c6b66c529ee6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:46.565539 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a8569a5a-2f55-42de-ab26-c6b66c529ee6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:46.572328 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a8569a5a-2f55-42de-ab26-c6b66c529ee6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:46.572779 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a8569a5a-2f55-42de-ab26-c6b66c529ee6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:46.573581 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a8569a5a-2f55-42de-ab26-c6b66c529ee6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:46.574012 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a8569a5a-2f55-42de-ab26-c6b66c529ee6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:46.711500 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a8569a5a-2f55-42de-ab26-c6b66c529ee6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:46.719566 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a8569a5a-2f55-42de-ab26-c6b66c529ee6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.160231 Jul 12 03:51:46.720477 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 156/322] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:46 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:46.734035 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b60e2d12-18cf-4417-9729-76dcdab0e2b2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:46.734677 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b60e2d12-18cf-4417-9729-76dcdab0e2b2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:46.745787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b60e2d12-18cf-4417-9729-76dcdab0e2b2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:46.746440 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b60e2d12-18cf-4417-9729-76dcdab0e2b2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:46.747586 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b60e2d12-18cf-4417-9729-76dcdab0e2b2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:46.748411 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b60e2d12-18cf-4417-9729-76dcdab0e2b2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:46.815239 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b60e2d12-18cf-4417-9729-76dcdab0e2b2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:46.823020 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b60e2d12-18cf-4417-9729-76dcdab0e2b2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1249 microversion: 2.1 time: 0.092823 Jul 12 03:51:46.823583 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 167/323] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:46 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:47.093081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b3838e7c-f91c-4741-b186-470f5f245bec tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:47.093909 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b3838e7c-f91c-4741-b186-470f5f245bec tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:47.100485 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b3838e7c-f91c-4741-b186-470f5f245bec tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:47.100930 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b3838e7c-f91c-4741-b186-470f5f245bec tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:47.101686 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b3838e7c-f91c-4741-b186-470f5f245bec tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:47.102114 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b3838e7c-f91c-4741-b186-470f5f245bec tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:47.120605 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:47.165002 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b3838e7c-f91c-4741-b186-470f5f245bec tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:47.172505 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b3838e7c-f91c-4741-b186-470f5f245bec tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1218 microversion: 2.1 time: 0.085248 Jul 12 03:51:47.173074 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 157/324] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:47 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:47.736987 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-84c2a4fa-6c3b-4b90-a39f-87b7793a7f33 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:47.737605 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-84c2a4fa-6c3b-4b90-a39f-87b7793a7f33 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:47.745994 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-84c2a4fa-6c3b-4b90-a39f-87b7793a7f33 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:47.746444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-84c2a4fa-6c3b-4b90-a39f-87b7793a7f33 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:47.747245 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-84c2a4fa-6c3b-4b90-a39f-87b7793a7f33 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:47.747683 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-84c2a4fa-6c3b-4b90-a39f-87b7793a7f33 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:47.839646 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4d0945a9-20c7-4350-b6d0-c0791e0ea060 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:47.840377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4d0945a9-20c7-4350-b6d0-c0791e0ea060 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:47.847354 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4d0945a9-20c7-4350-b6d0-c0791e0ea060 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:47.847799 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4d0945a9-20c7-4350-b6d0-c0791e0ea060 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:47.848591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4d0945a9-20c7-4350-b6d0-c0791e0ea060 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:47.849023 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4d0945a9-20c7-4350-b6d0-c0791e0ea060 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:47.883309 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-84c2a4fa-6c3b-4b90-a39f-87b7793a7f33 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:47.892298 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-84c2a4fa-6c3b-4b90-a39f-87b7793a7f33 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.158749 Jul 12 03:51:47.892895 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 168/325] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:47 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:48.059279 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4d0945a9-20c7-4350-b6d0-c0791e0ea060 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:48.067476 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4d0945a9-20c7-4350-b6d0-c0791e0ea060 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1249 microversion: 2.1 time: 0.231829 Jul 12 03:51:48.068137 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 158/326] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:47 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1249 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:48.193208 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4608a41d-d1c7-4bd3-902f-529fb0c21534 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:48.194216 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4608a41d-d1c7-4bd3-902f-529fb0c21534 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:48.204337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4608a41d-d1c7-4bd3-902f-529fb0c21534 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:48.204805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4608a41d-d1c7-4bd3-902f-529fb0c21534 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:48.205609 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4608a41d-d1c7-4bd3-902f-529fb0c21534 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:48.206051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4608a41d-d1c7-4bd3-902f-529fb0c21534 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:48.266646 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4608a41d-d1c7-4bd3-902f-529fb0c21534 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:48.274776 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4608a41d-d1c7-4bd3-902f-529fb0c21534 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1218 microversion: 2.1 time: 0.087999 Jul 12 03:51:48.275348 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 169/327] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:48 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:48.914164 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-558e4cd5-18b7-4cfc-81fa-24ff1ef4d413 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:48.915033 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-558e4cd5-18b7-4cfc-81fa-24ff1ef4d413 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:48.924371 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-558e4cd5-18b7-4cfc-81fa-24ff1ef4d413 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:48.924831 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-558e4cd5-18b7-4cfc-81fa-24ff1ef4d413 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:48.925589 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-558e4cd5-18b7-4cfc-81fa-24ff1ef4d413 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:48.926017 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-558e4cd5-18b7-4cfc-81fa-24ff1ef4d413 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:49.070325 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-558e4cd5-18b7-4cfc-81fa-24ff1ef4d413 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:49.080383 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-558e4cd5-18b7-4cfc-81fa-24ff1ef4d413 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.172914 Jul 12 03:51:49.080907 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 159/328] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:48 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:49.084816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d4c32a55-308e-4dff-9ee5-f90d9bd1b01c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:49.085433 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d4c32a55-308e-4dff-9ee5-f90d9bd1b01c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:49.092624 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d4c32a55-308e-4dff-9ee5-f90d9bd1b01c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:49.093105 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d4c32a55-308e-4dff-9ee5-f90d9bd1b01c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:49.093911 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d4c32a55-308e-4dff-9ee5-f90d9bd1b01c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:49.094350 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d4c32a55-308e-4dff-9ee5-f90d9bd1b01c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:49.158104 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d4c32a55-308e-4dff-9ee5-f90d9bd1b01c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:49.165835 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d4c32a55-308e-4dff-9ee5-f90d9bd1b01c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1249 microversion: 2.1 time: 0.084989 Jul 12 03:51:49.166331 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 170/329] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:49 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:49.295768 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6a8b5324-b470-4a23-bf2d-1bc1e03b6a77 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:49.296814 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6a8b5324-b470-4a23-bf2d-1bc1e03b6a77 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:49.304103 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a8b5324-b470-4a23-bf2d-1bc1e03b6a77 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:49.304596 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a8b5324-b470-4a23-bf2d-1bc1e03b6a77 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:49.305438 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a8b5324-b470-4a23-bf2d-1bc1e03b6a77 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:49.305912 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a8b5324-b470-4a23-bf2d-1bc1e03b6a77 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:49.375756 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6a8b5324-b470-4a23-bf2d-1bc1e03b6a77 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:49.384910 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6a8b5324-b470-4a23-bf2d-1bc1e03b6a77 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1218 microversion: 2.1 time: 0.095661 Jul 12 03:51:49.385742 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 160/330] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:49 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:50.099648 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c5395037-e8bb-455c-836a-bee112800c0e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:50.100361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c5395037-e8bb-455c-836a-bee112800c0e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:50.107545 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c5395037-e8bb-455c-836a-bee112800c0e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:50.108049 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c5395037-e8bb-455c-836a-bee112800c0e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:50.109170 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c5395037-e8bb-455c-836a-bee112800c0e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:50.109686 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c5395037-e8bb-455c-836a-bee112800c0e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:50.182600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0daa0207-5d81-4145-ab02-e1cf0bbd61f9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:50.183798 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0daa0207-5d81-4145-ab02-e1cf0bbd61f9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:50.190117 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0daa0207-5d81-4145-ab02-e1cf0bbd61f9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:50.190758 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0daa0207-5d81-4145-ab02-e1cf0bbd61f9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:50.191708 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0daa0207-5d81-4145-ab02-e1cf0bbd61f9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:50.192187 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0daa0207-5d81-4145-ab02-e1cf0bbd61f9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:50.250407 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c5395037-e8bb-455c-836a-bee112800c0e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:50.256954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0daa0207-5d81-4145-ab02-e1cf0bbd61f9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:50.258134 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c5395037-e8bb-455c-836a-bee112800c0e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.163354 Jul 12 03:51:50.258712 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 171/331] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:50 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:50.264390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0daa0207-5d81-4145-ab02-e1cf0bbd61f9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1249 microversion: 2.1 time: 0.085629 Jul 12 03:51:50.264933 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 161/332] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:50 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:50.410735 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-692d440c-a6fe-4de8-b111-358e486737fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:50.411607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-692d440c-a6fe-4de8-b111-358e486737fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:50.421969 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-692d440c-a6fe-4de8-b111-358e486737fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:50.422630 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-692d440c-a6fe-4de8-b111-358e486737fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:50.423385 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-692d440c-a6fe-4de8-b111-358e486737fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:50.423810 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-692d440c-a6fe-4de8-b111-358e486737fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:50.484755 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-692d440c-a6fe-4de8-b111-358e486737fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:50.492832 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-692d440c-a6fe-4de8-b111-358e486737fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1218 microversion: 2.1 time: 0.088619 Jul 12 03:51:50.493646 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 172/333] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:50 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:51.274940 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4932158c-b5a1-49a8-ac1f-f9652acc3d7c tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:51.275570 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4932158c-b5a1-49a8-ac1f-f9652acc3d7c tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:51.280886 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-382f00b1-b74a-40f8-bb95-22e1c29d8727 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:51.281499 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-382f00b1-b74a-40f8-bb95-22e1c29d8727 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:51.282035 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4932158c-b5a1-49a8-ac1f-f9652acc3d7c tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:51.282454 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4932158c-b5a1-49a8-ac1f-f9652acc3d7c tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:51.283253 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4932158c-b5a1-49a8-ac1f-f9652acc3d7c tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:51.283714 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4932158c-b5a1-49a8-ac1f-f9652acc3d7c tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:51.288776 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-382f00b1-b74a-40f8-bb95-22e1c29d8727 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:51.289268 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-382f00b1-b74a-40f8-bb95-22e1c29d8727 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:51.290024 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-382f00b1-b74a-40f8-bb95-22e1c29d8727 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:51.290465 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-382f00b1-b74a-40f8-bb95-22e1c29d8727 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:51.352127 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-382f00b1-b74a-40f8-bb95-22e1c29d8727 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:51.359772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-382f00b1-b74a-40f8-bb95-22e1c29d8727 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1249 microversion: 2.1 time: 0.082738 Jul 12 03:51:51.360547 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 173/334] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:51 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:51.415602 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4932158c-b5a1-49a8-ac1f-f9652acc3d7c tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:51.423343 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4932158c-b5a1-49a8-ac1f-f9652acc3d7c tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.152395 Jul 12 03:51:51.423912 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 162/335] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:51 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:51.513940 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f00f7af5-b398-4167-b60f-9fad241ca4f4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:51.514886 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f00f7af5-b398-4167-b60f-9fad241ca4f4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:51.522492 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f00f7af5-b398-4167-b60f-9fad241ca4f4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:51.522951 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f00f7af5-b398-4167-b60f-9fad241ca4f4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:51.523720 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f00f7af5-b398-4167-b60f-9fad241ca4f4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:51.524202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f00f7af5-b398-4167-b60f-9fad241ca4f4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:51.586950 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f00f7af5-b398-4167-b60f-9fad241ca4f4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:51.595002 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f00f7af5-b398-4167-b60f-9fad241ca4f4 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1218 microversion: 2.1 time: 0.087642 Jul 12 03:51:51.595578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 174/336] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:51 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:52.376753 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-12a8458c-4470-4b83-aecb-c9bb97b0ec40 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:52.377378 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-12a8458c-4470-4b83-aecb-c9bb97b0ec40 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:52.383649 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-12a8458c-4470-4b83-aecb-c9bb97b0ec40 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:52.384128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-12a8458c-4470-4b83-aecb-c9bb97b0ec40 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:52.384902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-12a8458c-4470-4b83-aecb-c9bb97b0ec40 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:52.385339 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-12a8458c-4470-4b83-aecb-c9bb97b0ec40 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:52.440541 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e8eeda9d-7fb7-40bb-8bc6-5296c9c00b68 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:52.441773 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e8eeda9d-7fb7-40bb-8bc6-5296c9c00b68 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:52.448426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e8eeda9d-7fb7-40bb-8bc6-5296c9c00b68 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:52.448978 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e8eeda9d-7fb7-40bb-8bc6-5296c9c00b68 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:52.449737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e8eeda9d-7fb7-40bb-8bc6-5296c9c00b68 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:52.450164 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e8eeda9d-7fb7-40bb-8bc6-5296c9c00b68 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:52.450558 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-12a8458c-4470-4b83-aecb-c9bb97b0ec40 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:52.458214 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-12a8458c-4470-4b83-aecb-c9bb97b0ec40 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1249 microversion: 2.1 time: 0.085432 Jul 12 03:51:52.458994 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 163/337] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:52 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:52.582623 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e8eeda9d-7fb7-40bb-8bc6-5296c9c00b68 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:52.592431 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e8eeda9d-7fb7-40bb-8bc6-5296c9c00b68 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.155933 Jul 12 03:51:52.593253 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 175/338] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:52 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:52.612513 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e8891632-fc3e-4a8f-92ce-d33e915f276e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:52.613216 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e8891632-fc3e-4a8f-92ce-d33e915f276e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:52.621852 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e8891632-fc3e-4a8f-92ce-d33e915f276e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:52.622515 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e8891632-fc3e-4a8f-92ce-d33e915f276e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:52.623645 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e8891632-fc3e-4a8f-92ce-d33e915f276e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:52.624348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e8891632-fc3e-4a8f-92ce-d33e915f276e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:52.688156 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e8891632-fc3e-4a8f-92ce-d33e915f276e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:52.695901 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e8891632-fc3e-4a8f-92ce-d33e915f276e tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1218 microversion: 2.1 time: 0.087221 Jul 12 03:51:52.696587 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 164/339] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:52 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:53.479390 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-070e68ff-119d-45de-9420-fbc2bb03ab10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:53.481015 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-070e68ff-119d-45de-9420-fbc2bb03ab10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:53.489627 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-070e68ff-119d-45de-9420-fbc2bb03ab10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:53.490087 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-070e68ff-119d-45de-9420-fbc2bb03ab10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:53.490839 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-070e68ff-119d-45de-9420-fbc2bb03ab10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:53.491278 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-070e68ff-119d-45de-9420-fbc2bb03ab10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:53.561573 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-070e68ff-119d-45de-9420-fbc2bb03ab10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:53.570983 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-070e68ff-119d-45de-9420-fbc2bb03ab10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1297 microversion: 2.1 time: 0.098141 Jul 12 03:51:53.571924 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 176/340] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:53 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1297 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:53.613588 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6d642c86-1e70-4f54-8251-28df2ecd7482 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:53.614190 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6d642c86-1e70-4f54-8251-28df2ecd7482 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:53.621175 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6d642c86-1e70-4f54-8251-28df2ecd7482 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:53.621621 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6d642c86-1e70-4f54-8251-28df2ecd7482 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:53.622388 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6d642c86-1e70-4f54-8251-28df2ecd7482 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:53.622818 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6d642c86-1e70-4f54-8251-28df2ecd7482 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:53.712766 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cd9f80d8-c45b-4e59-a2c4-d0ab74c1a3ac tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:53.713409 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-cd9f80d8-c45b-4e59-a2c4-d0ab74c1a3ac tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:53.720051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd9f80d8-c45b-4e59-a2c4-d0ab74c1a3ac tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:53.720525 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd9f80d8-c45b-4e59-a2c4-d0ab74c1a3ac tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:53.721275 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd9f80d8-c45b-4e59-a2c4-d0ab74c1a3ac tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:53.721703 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd9f80d8-c45b-4e59-a2c4-d0ab74c1a3ac tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:53.764631 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6d642c86-1e70-4f54-8251-28df2ecd7482 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:53.775988 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6d642c86-1e70-4f54-8251-28df2ecd7482 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.166295 Jul 12 03:51:53.785466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 165/341] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:53 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:53.792184 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cd9f80d8-c45b-4e59-a2c4-d0ab74c1a3ac tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:53.800121 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cd9f80d8-c45b-4e59-a2c4-d0ab74c1a3ac tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1266 microversion: 2.1 time: 0.091233 Jul 12 03:51:53.800690 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 177/342] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:53 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:54.150996 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-3df7b0d1-f111-451e-a315-4705b9fc5844 req-1e6df2cb-42db-44be-a270-b83f5a7eb74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819ccee1-8d15-4186-9538-b903779cdf2f", "name": "network-vif-plugged", "status": "completed", "tag": "0f893515-f3d7-4404-9069-2651d8e631d6"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:54.166597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-3df7b0d1-f111-451e-a315-4705b9fc5844 req-1e6df2cb-42db-44be-a270-b83f5a7eb74f service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:54.170832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-3df7b0d1-f111-451e-a315-4705b9fc5844 req-1e6df2cb-42db-44be-a270-b83f5a7eb74f service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:54.196268 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-3df7b0d1-f111-451e-a315-4705b9fc5844 req-1e6df2cb-42db-44be-a270-b83f5a7eb74f service nova] Creating event network-vif-plugged:0f893515-f3d7-4404-9069-2651d8e631d6 for instance 819ccee1-8d15-4186-9538-b903779cdf2f on hv-cinder-84773 Jul 12 03:51:54.203786 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-3df7b0d1-f111-451e-a315-4705b9fc5844 req-1e6df2cb-42db-44be-a270-b83f5a7eb74f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057229 Jul 12 03:51:54.206808 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 166/343] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:51:54.588797 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-fb015578-bba4-4f70-b2d9-e35af18b5d7a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:54.589396 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-fb015578-bba4-4f70-b2d9-e35af18b5d7a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:54.596342 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb015578-bba4-4f70-b2d9-e35af18b5d7a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:54.597064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb015578-bba4-4f70-b2d9-e35af18b5d7a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:54.598035 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb015578-bba4-4f70-b2d9-e35af18b5d7a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:54.598508 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb015578-bba4-4f70-b2d9-e35af18b5d7a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:54.616722 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=14 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:54.674259 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-fb015578-bba4-4f70-b2d9-e35af18b5d7a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:54.682874 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-fb015578-bba4-4f70-b2d9-e35af18b5d7a tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1303 microversion: 2.1 time: 0.098082 Jul 12 03:51:54.694014 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 178/344] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:54 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:54.796141 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-111fb37f-ddcc-4bb5-8f34-95f3172c73e4 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:54.797428 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-111fb37f-ddcc-4bb5-8f34-95f3172c73e4 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:54.804355 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=4 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:54.805336 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=18 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:54.807116 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-111fb37f-ddcc-4bb5-8f34-95f3172c73e4 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:54.807560 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-111fb37f-ddcc-4bb5-8f34-95f3172c73e4 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:54.808645 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-111fb37f-ddcc-4bb5-8f34-95f3172c73e4 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:54.809078 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-111fb37f-ddcc-4bb5-8f34-95f3172c73e4 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:54.820792 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-51003a8a-e1a7-4f22-a655-c46df3433eb7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:54.821994 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-51003a8a-e1a7-4f22-a655-c46df3433eb7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:54.828861 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-51003a8a-e1a7-4f22-a655-c46df3433eb7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:54.829559 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-51003a8a-e1a7-4f22-a655-c46df3433eb7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:54.830513 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-51003a8a-e1a7-4f22-a655-c46df3433eb7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:54.831090 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-51003a8a-e1a7-4f22-a655-c46df3433eb7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:54.912263 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-51003a8a-e1a7-4f22-a655-c46df3433eb7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:54.926867 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-51003a8a-e1a7-4f22-a655-c46df3433eb7 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1272 microversion: 2.1 time: 0.112872 Jul 12 03:51:54.927648 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 179/345] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:54 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:55.055980 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-111fb37f-ddcc-4bb5-8f34-95f3172c73e4 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:55.065496 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-111fb37f-ddcc-4bb5-8f34-95f3172c73e4 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.275263 Jul 12 03:51:55.066514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 167/346] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:54 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:55.701004 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7c667ced-cd0e-4ee0-bbd9-4e6862f93928 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:55.702679 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7c667ced-cd0e-4ee0-bbd9-4e6862f93928 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:55.709969 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c667ced-cd0e-4ee0-bbd9-4e6862f93928 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:55.710500 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c667ced-cd0e-4ee0-bbd9-4e6862f93928 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:55.711216 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c667ced-cd0e-4ee0-bbd9-4e6862f93928 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:55.711652 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c667ced-cd0e-4ee0-bbd9-4e6862f93928 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:55.929788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7c667ced-cd0e-4ee0-bbd9-4e6862f93928 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:55.943756 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7c667ced-cd0e-4ee0-bbd9-4e6862f93928 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.246097 Jul 12 03:51:55.944351 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-72bd04d3-682c-4dcb-b6e0-a5438d17979d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:55.944822 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 180/347] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:55 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:55.944954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-72bd04d3-682c-4dcb-b6e0-a5438d17979d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:55.951657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-72bd04d3-682c-4dcb-b6e0-a5438d17979d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:55.952348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-72bd04d3-682c-4dcb-b6e0-a5438d17979d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:55.953268 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-72bd04d3-682c-4dcb-b6e0-a5438d17979d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:55.953877 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-72bd04d3-682c-4dcb-b6e0-a5438d17979d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:56.083570 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-572dc9ba-c174-4259-b758-463951548e86 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:56.084841 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-572dc9ba-c174-4259-b758-463951548e86 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:56.094055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-572dc9ba-c174-4259-b758-463951548e86 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:56.095039 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-572dc9ba-c174-4259-b758-463951548e86 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:56.096208 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-572dc9ba-c174-4259-b758-463951548e86 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:56.096872 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-572dc9ba-c174-4259-b758-463951548e86 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:56.231517 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-72bd04d3-682c-4dcb-b6e0-a5438d17979d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:56.241992 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-72bd04d3-682c-4dcb-b6e0-a5438d17979d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1314 microversion: 2.1 time: 0.300612 Jul 12 03:51:56.242566 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 168/348] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:55 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:56.343956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-8814a268-bbbb-4ded-b64e-95268b63365f req-d846cc7e-ee85-48b9-848a-1fdfea46b20b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e3bc04-35b0-412b-b8d6-65165bc79e60", "tag": "a1b17494-72de-4c33-8c66-6af3d34f96b4"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:56.354367 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-8814a268-bbbb-4ded-b64e-95268b63365f req-d846cc7e-ee85-48b9-848a-1fdfea46b20b service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:56.354806 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-8814a268-bbbb-4ded-b64e-95268b63365f req-d846cc7e-ee85-48b9-848a-1fdfea46b20b service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:56.368655 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-8814a268-bbbb-4ded-b64e-95268b63365f req-d846cc7e-ee85-48b9-848a-1fdfea46b20b service nova] Creating event network-changed:a1b17494-72de-4c33-8c66-6af3d34f96b4 for instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 on hv-cinder-84773 Jul 12 03:51:56.375631 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-8814a268-bbbb-4ded-b64e-95268b63365f req-d846cc7e-ee85-48b9-848a-1fdfea46b20b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049562 Jul 12 03:51:56.376704 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 169/349] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:51:56.383108 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-b24f6ae9-fabb-4b2e-8ea5-30b00aa25c59 req-bfa10edd-61ac-423b-adc0-773a22cf4dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee6a36c-bb82-426b-887c-4751a86c86c6", "tag": "86e763d9-f470-4437-a522-b77fc1d939bf"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:51:56.394262 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-b24f6ae9-fabb-4b2e-8ea5-30b00aa25c59 req-bfa10edd-61ac-423b-adc0-773a22cf4dbf service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:56.394941 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-b24f6ae9-fabb-4b2e-8ea5-30b00aa25c59 req-bfa10edd-61ac-423b-adc0-773a22cf4dbf service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:56.408965 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-b24f6ae9-fabb-4b2e-8ea5-30b00aa25c59 req-bfa10edd-61ac-423b-adc0-773a22cf4dbf service nova] Creating event network-changed:86e763d9-f470-4437-a522-b77fc1d939bf for instance 7ee6a36c-bb82-426b-887c-4751a86c86c6 on hv-cinder-84773 Jul 12 03:51:56.413788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-b24f6ae9-fabb-4b2e-8ea5-30b00aa25c59 req-bfa10edd-61ac-423b-adc0-773a22cf4dbf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035567 Jul 12 03:51:56.414668 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 170/350] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:51:56.460916 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-572dc9ba-c174-4259-b758-463951548e86 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:56.469060 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-572dc9ba-c174-4259-b758-463951548e86 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1318 microversion: 2.1 time: 0.389573 Jul 12 03:51:56.469639 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 181/351] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:56 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:51:56.966610 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6565516a-b553-4cda-99a1-c8efb9695cd2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:56.967616 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6565516a-b553-4cda-99a1-c8efb9695cd2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:56.975460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6565516a-b553-4cda-99a1-c8efb9695cd2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:56.975905 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6565516a-b553-4cda-99a1-c8efb9695cd2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:56.976707 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6565516a-b553-4cda-99a1-c8efb9695cd2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:56.977154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6565516a-b553-4cda-99a1-c8efb9695cd2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:57.146414 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6565516a-b553-4cda-99a1-c8efb9695cd2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:57.155192 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6565516a-b553-4cda-99a1-c8efb9695cd2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.195512 Jul 12 03:51:57.156055 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 171/352] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:56 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:57.259047 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b31eb9a2-3f14-4b0a-85ee-847e4acdea4c tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:57.259654 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b31eb9a2-3f14-4b0a-85ee-847e4acdea4c tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:57.266227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b31eb9a2-3f14-4b0a-85ee-847e4acdea4c tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:57.267242 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b31eb9a2-3f14-4b0a-85ee-847e4acdea4c tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:57.268274 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b31eb9a2-3f14-4b0a-85ee-847e4acdea4c tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:57.268847 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b31eb9a2-3f14-4b0a-85ee-847e4acdea4c tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:57.468598 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b31eb9a2-3f14-4b0a-85ee-847e4acdea4c tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:57.476772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b31eb9a2-3f14-4b0a-85ee-847e4acdea4c tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1314 microversion: 2.1 time: 0.221561 Jul 12 03:51:57.477557 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 182/353] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:57 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:57.485957 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e19c4eab-22bf-470e-b21f-4d67e8a686ad tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:57.486623 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e19c4eab-22bf-470e-b21f-4d67e8a686ad tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:57.492632 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e19c4eab-22bf-470e-b21f-4d67e8a686ad tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:57.493073 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e19c4eab-22bf-470e-b21f-4d67e8a686ad tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:57.493824 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e19c4eab-22bf-470e-b21f-4d67e8a686ad tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:57.494244 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e19c4eab-22bf-470e-b21f-4d67e8a686ad tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:57.656597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e19c4eab-22bf-470e-b21f-4d67e8a686ad tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:57.665204 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e19c4eab-22bf-470e-b21f-4d67e8a686ad tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1508 microversion: 2.1 time: 0.182868 Jul 12 03:51:57.669069 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 172/354] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:57 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:58.172519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d1499d50-2dfd-4bd4-9e7b-7ac8efdc49cc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:58.173105 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d1499d50-2dfd-4bd4-9e7b-7ac8efdc49cc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:58.179373 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1499d50-2dfd-4bd4-9e7b-7ac8efdc49cc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:58.179768 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1499d50-2dfd-4bd4-9e7b-7ac8efdc49cc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:58.180566 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1499d50-2dfd-4bd4-9e7b-7ac8efdc49cc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:58.181003 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1499d50-2dfd-4bd4-9e7b-7ac8efdc49cc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:58.199143 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:51:58.318852 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d1499d50-2dfd-4bd4-9e7b-7ac8efdc49cc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:58.326568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d1499d50-2dfd-4bd4-9e7b-7ac8efdc49cc tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.157932 Jul 12 03:51:58.327213 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 183/355] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:58 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:58.494349 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6656318d-b87b-4b6b-bcd9-75e0b00efb37 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:58.495037 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6656318d-b87b-4b6b-bcd9-75e0b00efb37 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:58.501586 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6656318d-b87b-4b6b-bcd9-75e0b00efb37 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:58.502166 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6656318d-b87b-4b6b-bcd9-75e0b00efb37 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:58.502928 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6656318d-b87b-4b6b-bcd9-75e0b00efb37 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:58.503356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6656318d-b87b-4b6b-bcd9-75e0b00efb37 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:58.662066 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6656318d-b87b-4b6b-bcd9-75e0b00efb37 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:58.670447 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6656318d-b87b-4b6b-bcd9-75e0b00efb37 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1314 microversion: 2.1 time: 0.180222 Jul 12 03:51:58.671431 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 173/356] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:58 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:59.345214 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-17386ea2-e8fc-43fc-b7fc-21ea5279e675 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:59.346126 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-17386ea2-e8fc-43fc-b7fc-21ea5279e675 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:59.353014 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-17386ea2-e8fc-43fc-b7fc-21ea5279e675 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:59.353509 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-17386ea2-e8fc-43fc-b7fc-21ea5279e675 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:59.354759 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-17386ea2-e8fc-43fc-b7fc-21ea5279e675 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:59.357580 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-17386ea2-e8fc-43fc-b7fc-21ea5279e675 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:59.509365 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-17386ea2-e8fc-43fc-b7fc-21ea5279e675 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:59.517898 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-17386ea2-e8fc-43fc-b7fc-21ea5279e675 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.176548 Jul 12 03:51:59.518481 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 184/357] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:59 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:51:59.687420 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f9d622e6-14a4-4379-b191-ec97f63b3dc9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:51:59.688191 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f9d622e6-14a4-4379-b191-ec97f63b3dc9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:51:59.694650 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f9d622e6-14a4-4379-b191-ec97f63b3dc9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:59.695095 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f9d622e6-14a4-4379-b191-ec97f63b3dc9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:59.695863 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f9d622e6-14a4-4379-b191-ec97f63b3dc9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:51:59.696334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f9d622e6-14a4-4379-b191-ec97f63b3dc9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:51:59.833372 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f9d622e6-14a4-4379-b191-ec97f63b3dc9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:51:59.844414 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f9d622e6-14a4-4379-b191-ec97f63b3dc9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1314 microversion: 2.1 time: 0.160517 Jul 12 03:51:59.845168 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 174/358] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:51:59 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:00.534920 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2170c993-4b2a-4a4f-b88a-18309b997d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:00.535578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2170c993-4b2a-4a4f-b88a-18309b997d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:00.542600 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2170c993-4b2a-4a4f-b88a-18309b997d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:00.543058 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2170c993-4b2a-4a4f-b88a-18309b997d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:00.543819 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2170c993-4b2a-4a4f-b88a-18309b997d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:00.544299 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2170c993-4b2a-4a4f-b88a-18309b997d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:00.682321 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-2170c993-4b2a-4a4f-b88a-18309b997d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:00.690103 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2170c993-4b2a-4a4f-b88a-18309b997d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.159201 Jul 12 03:52:00.690682 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 185/359] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:00 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:00.867465 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c8d8a0d4-2798-449d-b63e-6e0b3cec2d26 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:00.868481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c8d8a0d4-2798-449d-b63e-6e0b3cec2d26 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:00.871665 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:00.880530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c8d8a0d4-2798-449d-b63e-6e0b3cec2d26 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:00.881003 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c8d8a0d4-2798-449d-b63e-6e0b3cec2d26 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:00.881778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c8d8a0d4-2798-449d-b63e-6e0b3cec2d26 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:00.882212 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c8d8a0d4-2798-449d-b63e-6e0b3cec2d26 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:01.018829 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c8d8a0d4-2798-449d-b63e-6e0b3cec2d26 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:01.027165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c8d8a0d4-2798-449d-b63e-6e0b3cec2d26 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1314 microversion: 2.1 time: 0.166665 Jul 12 03:52:01.027850 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 175/360] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:00 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:01.712301 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a95f8227-c035-4ebf-82a0-e1ca6373b1cb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:01.713192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a95f8227-c035-4ebf-82a0-e1ca6373b1cb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:01.721654 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a95f8227-c035-4ebf-82a0-e1ca6373b1cb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:01.722137 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a95f8227-c035-4ebf-82a0-e1ca6373b1cb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:01.722911 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a95f8227-c035-4ebf-82a0-e1ca6373b1cb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:01.723522 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a95f8227-c035-4ebf-82a0-e1ca6373b1cb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:01.887978 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a95f8227-c035-4ebf-82a0-e1ca6373b1cb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:01.896103 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a95f8227-c035-4ebf-82a0-e1ca6373b1cb tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.188397 Jul 12 03:52:01.905466 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 186/361] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:01 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:02.047538 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2f0a86df-758e-4963-a011-ed8bd312b48d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:02.048443 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-2f0a86df-758e-4963-a011-ed8bd312b48d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:02.057534 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2f0a86df-758e-4963-a011-ed8bd312b48d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:02.058175 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2f0a86df-758e-4963-a011-ed8bd312b48d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:02.059238 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2f0a86df-758e-4963-a011-ed8bd312b48d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:02.059844 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2f0a86df-758e-4963-a011-ed8bd312b48d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:02.065261 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=100 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:02.204371 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-2f0a86df-758e-4963-a011-ed8bd312b48d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:02.212243 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-2f0a86df-758e-4963-a011-ed8bd312b48d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1314 microversion: 2.1 time: 0.170265 Jul 12 03:52:02.212808 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 176/362] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:02 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:02.912410 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b7cb23b5-3818-44d8-9931-bea046e14d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:02.912984 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b7cb23b5-3818-44d8-9931-bea046e14d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:02.920210 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b7cb23b5-3818-44d8-9931-bea046e14d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:02.920657 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b7cb23b5-3818-44d8-9931-bea046e14d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:02.921426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b7cb23b5-3818-44d8-9931-bea046e14d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:02.921853 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b7cb23b5-3818-44d8-9931-bea046e14d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:03.058443 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b7cb23b5-3818-44d8-9931-bea046e14d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:03.066238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b7cb23b5-3818-44d8-9931-bea046e14d28 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.157820 Jul 12 03:52:03.066769 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 187/363] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:02 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:03.233652 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5986cc8f-5d0f-4b07-ba2e-e2735a0495c8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:03.234653 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5986cc8f-5d0f-4b07-ba2e-e2735a0495c8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:03.242682 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5986cc8f-5d0f-4b07-ba2e-e2735a0495c8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:03.243125 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5986cc8f-5d0f-4b07-ba2e-e2735a0495c8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:03.243889 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5986cc8f-5d0f-4b07-ba2e-e2735a0495c8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:03.244375 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5986cc8f-5d0f-4b07-ba2e-e2735a0495c8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:03.386616 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5986cc8f-5d0f-4b07-ba2e-e2735a0495c8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:03.394686 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5986cc8f-5d0f-4b07-ba2e-e2735a0495c8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1314 microversion: 2.1 time: 0.167624 Jul 12 03:52:03.395257 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 177/364] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:03 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:04.083646 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8e901703-97b4-47aa-be4d-6faacf787149 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:04.084439 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8e901703-97b4-47aa-be4d-6faacf787149 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:04.094415 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8e901703-97b4-47aa-be4d-6faacf787149 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:04.094943 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8e901703-97b4-47aa-be4d-6faacf787149 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:04.095909 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8e901703-97b4-47aa-be4d-6faacf787149 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:04.096804 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8e901703-97b4-47aa-be4d-6faacf787149 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:04.236845 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8e901703-97b4-47aa-be4d-6faacf787149 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:04.245249 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8e901703-97b4-47aa-be4d-6faacf787149 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.166269 Jul 12 03:52:04.246102 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 188/365] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:04 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:04.411862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4f3d20d3-299f-4cc4-9b07-4e40bbceb574 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:04.412608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4f3d20d3-299f-4cc4-9b07-4e40bbceb574 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:04.419910 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4f3d20d3-299f-4cc4-9b07-4e40bbceb574 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:04.420407 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4f3d20d3-299f-4cc4-9b07-4e40bbceb574 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:04.421228 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4f3d20d3-299f-4cc4-9b07-4e40bbceb574 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:04.421778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4f3d20d3-299f-4cc4-9b07-4e40bbceb574 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:04.562071 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4f3d20d3-299f-4cc4-9b07-4e40bbceb574 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:04.570297 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4f3d20d3-299f-4cc4-9b07-4e40bbceb574 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1314 microversion: 2.1 time: 0.162940 Jul 12 03:52:04.570958 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 178/366] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:04 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:05.139473 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1766447956", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-359074052", "security_groups": [{"name": "tempest-secgroup-smoke-360543779"}], "block_device_mapping_v2": [{"uuid": "063903b2-301d-4e84-97d8-a2eda2c3be57", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb793af7-088d-44b6-bebd-8609e6743321"}]}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:05.255825 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.network.neutron [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] validate_networks() for [('cb793af7-088d-44b6-bebd-8609e6743321', None, None, None, None, None)] {{(pid=124434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:52:05.262276 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fabca6f0-9b45-4d34-a6de-642e7dfb9468 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:05.262879 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-fabca6f0-9b45-4d34-a6de-642e7dfb9468 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:05.269516 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fabca6f0-9b45-4d34-a6de-642e7dfb9468 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:05.269998 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fabca6f0-9b45-4d34-a6de-642e7dfb9468 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:05.270752 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fabca6f0-9b45-4d34-a6de-642e7dfb9468 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:05.271173 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fabca6f0-9b45-4d34-a6de-642e7dfb9468 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:05.412885 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-fabca6f0-9b45-4d34-a6de-642e7dfb9468 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:05.420913 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-fabca6f0-9b45-4d34-a6de-642e7dfb9468 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.162409 Jul 12 03:52:05.421981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 179/367] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:05 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:05.586834 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-de9a28ce-2214-403d-a5c2-3a6c7d8ee675 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:05.587542 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-de9a28ce-2214-403d-a5c2-3a6c7d8ee675 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:05.593838 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-de9a28ce-2214-403d-a5c2-3a6c7d8ee675 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:05.594288 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-de9a28ce-2214-403d-a5c2-3a6c7d8ee675 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:05.595044 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-de9a28ce-2214-403d-a5c2-3a6c7d8ee675 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:05.595453 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-de9a28ce-2214-403d-a5c2-3a6c7d8ee675 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:05.661968 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Flavor limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:52:05.662563 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Image limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:52:05.663099 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Flavor pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:52:05.663678 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Image pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:52:05.664295 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:52:05.673775 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:05.674260 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:05.675070 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:05.675505 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:05.693871 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Getting quotas for project 99d9e85c63234c77889f856bf95288f5. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:52:05.698077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Getting quotas for user 46d5c3f98d924538a34c4b3a57fcac14 and project 99d9e85c63234c77889f856bf95288f5. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:52:05.735904 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-de9a28ce-2214-403d-a5c2-3a6c7d8ee675 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:05.744677 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-de9a28ce-2214-403d-a5c2-3a6c7d8ee675 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1314 microversion: 2.1 time: 0.161744 Jul 12 03:52:05.745373 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 180/368] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:05 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:05.755567 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Going to run 1 instances... {{(pid=124434) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:52:05.757712 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='063903b2-301d-4e84-97d8-a2eda2c3be57',volume_size=None,volume_type=None)] {{(pid=124434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:52:05.899238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ce589c19-0090-499c-aabd-1611be7202ce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.763737 Jul 12 03:52:05.899870 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 189/369] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:52:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 03:52:05.910588 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ba418975-7031-4ba1-8342-7a2efe056a72 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:05.911590 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ba418975-7031-4ba1-8342-7a2efe056a72 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:05.968222 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ba418975-7031-4ba1-8342-7a2efe056a72 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:05.974904 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ba418975-7031-4ba1-8342-7a2efe056a72 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1094 microversion: 2.1 time: 0.068537 Jul 12 03:52:05.975470 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 181/370] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:05 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:06.449896 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0973aeec-a0c4-42ba-ab6a-eac89aa3a57b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:06.451199 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0973aeec-a0c4-42ba-ab6a-eac89aa3a57b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:06.462943 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0973aeec-a0c4-42ba-ab6a-eac89aa3a57b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:06.463933 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0973aeec-a0c4-42ba-ab6a-eac89aa3a57b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:06.465101 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0973aeec-a0c4-42ba-ab6a-eac89aa3a57b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:06.465801 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0973aeec-a0c4-42ba-ab6a-eac89aa3a57b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:06.762177 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4c1478ba-965a-44e1-a019-5858280fa67d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:06.762965 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4c1478ba-965a-44e1-a019-5858280fa67d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:06.770042 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4c1478ba-965a-44e1-a019-5858280fa67d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:06.770900 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4c1478ba-965a-44e1-a019-5858280fa67d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:06.772663 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4c1478ba-965a-44e1-a019-5858280fa67d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:06.773345 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4c1478ba-965a-44e1-a019-5858280fa67d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:06.791724 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0973aeec-a0c4-42ba-ab6a-eac89aa3a57b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:06.805221 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0973aeec-a0c4-42ba-ab6a-eac89aa3a57b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.370438 Jul 12 03:52:06.805889 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 190/371] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:06 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:06.818236 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-87da1775-dc55-4906-b4c3-1b824b029108 req-ad92967a-f59f-4d27-9dd8-ce266318416a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee6a36c-bb82-426b-887c-4751a86c86c6", "name": "network-vif-plugged", "status": "completed", "tag": "86e763d9-f470-4437-a522-b77fc1d939bf"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:06.828530 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-87da1775-dc55-4906-b4c3-1b824b029108 req-ad92967a-f59f-4d27-9dd8-ce266318416a service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:06.829291 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-87da1775-dc55-4906-b4c3-1b824b029108 req-ad92967a-f59f-4d27-9dd8-ce266318416a service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:06.848499 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-87da1775-dc55-4906-b4c3-1b824b029108 req-ad92967a-f59f-4d27-9dd8-ce266318416a service nova] Creating event network-vif-plugged:86e763d9-f470-4437-a522-b77fc1d939bf for instance 7ee6a36c-bb82-426b-887c-4751a86c86c6 on hv-cinder-84773 Jul 12 03:52:06.856682 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-87da1775-dc55-4906-b4c3-1b824b029108 req-ad92967a-f59f-4d27-9dd8-ce266318416a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046891 Jul 12 03:52:06.857841 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 191/372] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:52:06.944353 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4c1478ba-965a-44e1-a019-5858280fa67d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:06.953172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4c1478ba-965a-44e1-a019-5858280fa67d tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1314 microversion: 2.1 time: 0.194752 Jul 12 03:52:06.954494 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 182/373] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:06 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:06.991475 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0336e91f-6b60-4392-91ce-c3ee149785a5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:06.992209 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0336e91f-6b60-4392-91ce-c3ee149785a5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:06.998580 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0336e91f-6b60-4392-91ce-c3ee149785a5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:06.999031 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0336e91f-6b60-4392-91ce-c3ee149785a5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:06.999797 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0336e91f-6b60-4392-91ce-c3ee149785a5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:07.000278 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0336e91f-6b60-4392-91ce-c3ee149785a5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:07.101356 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0336e91f-6b60-4392-91ce-c3ee149785a5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:07.112521 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0336e91f-6b60-4392-91ce-c3ee149785a5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1192 microversion: 2.1 time: 0.125178 Jul 12 03:52:07.113732 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 192/374] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:06 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1192 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:07.822845 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9affbf61-1cfd-4582-bd84-3658364b5e41 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:07.823460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9affbf61-1cfd-4582-bd84-3658364b5e41 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:07.829939 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9affbf61-1cfd-4582-bd84-3658364b5e41 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:07.830385 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9affbf61-1cfd-4582-bd84-3658364b5e41 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:07.831164 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9affbf61-1cfd-4582-bd84-3658364b5e41 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:07.831574 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9affbf61-1cfd-4582-bd84-3658364b5e41 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:07.970738 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e68c5552-a053-4890-866e-c0f9a9055b3a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:07.971383 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e68c5552-a053-4890-866e-c0f9a9055b3a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:07.974587 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9affbf61-1cfd-4582-bd84-3658364b5e41 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:07.978517 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e68c5552-a053-4890-866e-c0f9a9055b3a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:07.978974 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e68c5552-a053-4890-866e-c0f9a9055b3a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:07.979743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e68c5552-a053-4890-866e-c0f9a9055b3a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:07.980196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e68c5552-a053-4890-866e-c0f9a9055b3a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:07.982474 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9affbf61-1cfd-4582-bd84-3658364b5e41 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.163671 Jul 12 03:52:07.984019 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 183/375] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:07 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:08.116455 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e68c5552-a053-4890-866e-c0f9a9055b3a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:08.129358 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3189e8e1-8d63-4fc1-8a39-4f3589c06b0d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:08.129995 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e68c5552-a053-4890-866e-c0f9a9055b3a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1314 microversion: 2.1 time: 0.162890 Jul 12 03:52:08.130483 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3189e8e1-8d63-4fc1-8a39-4f3589c06b0d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:08.130610 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 193/376] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:07 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:08.143037 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3189e8e1-8d63-4fc1-8a39-4f3589c06b0d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:08.143704 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3189e8e1-8d63-4fc1-8a39-4f3589c06b0d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:08.145633 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3189e8e1-8d63-4fc1-8a39-4f3589c06b0d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:08.146127 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3189e8e1-8d63-4fc1-8a39-4f3589c06b0d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:08.219701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3189e8e1-8d63-4fc1-8a39-4f3589c06b0d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:08.229041 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3189e8e1-8d63-4fc1-8a39-4f3589c06b0d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1210 microversion: 2.1 time: 0.103817 Jul 12 03:52:08.229625 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 184/377] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:08 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:09.002133 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c369f761-7dab-4e92-9d88-e394f734cdf7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:09.003577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c369f761-7dab-4e92-9d88-e394f734cdf7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:09.014890 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c369f761-7dab-4e92-9d88-e394f734cdf7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:09.017802 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c369f761-7dab-4e92-9d88-e394f734cdf7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:09.019467 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c369f761-7dab-4e92-9d88-e394f734cdf7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:09.021782 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c369f761-7dab-4e92-9d88-e394f734cdf7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:09.151747 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4363592b-b106-45bb-87bc-15656544427a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:09.153247 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4363592b-b106-45bb-87bc-15656544427a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:09.160913 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4363592b-b106-45bb-87bc-15656544427a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:09.161958 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4363592b-b106-45bb-87bc-15656544427a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:09.163001 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4363592b-b106-45bb-87bc-15656544427a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:09.164279 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4363592b-b106-45bb-87bc-15656544427a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:09.321289 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c369f761-7dab-4e92-9d88-e394f734cdf7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:09.330390 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c369f761-7dab-4e92-9d88-e394f734cdf7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.332653 Jul 12 03:52:09.339586 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 194/378] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:08 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:09.339586 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-ca115341-2cab-4881-a6ed-d74eddfb97ff req-1bd34c99-fac8-4d92-ba11-33743142ea00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e3bc04-35b0-412b-b8d6-65165bc79e60", "name": "network-vif-plugged", "status": "completed", "tag": "a1b17494-72de-4c33-8c66-6af3d34f96b4"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:09.344226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-ca115341-2cab-4881-a6ed-d74eddfb97ff req-1bd34c99-fac8-4d92-ba11-33743142ea00 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:09.344542 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-ca115341-2cab-4881-a6ed-d74eddfb97ff req-1bd34c99-fac8-4d92-ba11-33743142ea00 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:09.355663 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-ca115341-2cab-4881-a6ed-d74eddfb97ff req-1bd34c99-fac8-4d92-ba11-33743142ea00 service nova] Creating event network-vif-plugged:a1b17494-72de-4c33-8c66-6af3d34f96b4 for instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 on hv-cinder-84773 Jul 12 03:52:09.360845 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-ca115341-2cab-4881-a6ed-d74eddfb97ff req-1bd34c99-fac8-4d92-ba11-33743142ea00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028665 Jul 12 03:52:09.361535 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 195/379] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:52:09.367077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-017d6765-30a2-4b01-b094-c837be7d0178 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:09.368137 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-017d6765-30a2-4b01-b094-c837be7d0178 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:09.375351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-017d6765-30a2-4b01-b094-c837be7d0178 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:09.376760 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-017d6765-30a2-4b01-b094-c837be7d0178 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:09.377763 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-017d6765-30a2-4b01-b094-c837be7d0178 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:09.378353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-017d6765-30a2-4b01-b094-c837be7d0178 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:09.453460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4363592b-b106-45bb-87bc-15656544427a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:09.467286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4363592b-b106-45bb-87bc-15656544427a tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1314 microversion: 2.1 time: 0.321678 Jul 12 03:52:09.469934 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 185/380] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:09 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:09.590409 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-017d6765-30a2-4b01-b094-c837be7d0178 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:09.599613 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-017d6765-30a2-4b01-b094-c837be7d0178 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.236319 Jul 12 03:52:09.602057 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 196/381] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:09 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:09.741817 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-532a92e3-3d35-4fc7-a324-1cafec5d1943 req-08408bbc-d6fe-4f11-97a6-72de0464d916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f988bb-503a-447f-a796-236af82ab9f6", "tag": "4ba9303d-bc54-4f55-bfa4-2008f5d2bd62"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:09.759673 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-532a92e3-3d35-4fc7-a324-1cafec5d1943 req-08408bbc-d6fe-4f11-97a6-72de0464d916 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:09.760411 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-532a92e3-3d35-4fc7-a324-1cafec5d1943 req-08408bbc-d6fe-4f11-97a6-72de0464d916 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:09.782926 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-532a92e3-3d35-4fc7-a324-1cafec5d1943 req-08408bbc-d6fe-4f11-97a6-72de0464d916 service nova] Creating event network-changed:4ba9303d-bc54-4f55-bfa4-2008f5d2bd62 for instance 58f988bb-503a-447f-a796-236af82ab9f6 on hv-cinder-84773 Jul 12 03:52:09.788834 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-532a92e3-3d35-4fc7-a324-1cafec5d1943 req-08408bbc-d6fe-4f11-97a6-72de0464d916 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050791 Jul 12 03:52:09.789468 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 186/382] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:52:10.347421 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e7b106d8-94cd-4517-886f-a238ec1f2b1e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:10.348402 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e7b106d8-94cd-4517-886f-a238ec1f2b1e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:10.355066 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e7b106d8-94cd-4517-886f-a238ec1f2b1e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:10.355514 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e7b106d8-94cd-4517-886f-a238ec1f2b1e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:10.356333 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e7b106d8-94cd-4517-886f-a238ec1f2b1e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:10.356773 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e7b106d8-94cd-4517-886f-a238ec1f2b1e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:10.486269 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3d38671e-cd0b-4c0d-b71e-631922d34a56 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:10.487795 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3d38671e-cd0b-4c0d-b71e-631922d34a56 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:10.496512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3d38671e-cd0b-4c0d-b71e-631922d34a56 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:10.497924 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3d38671e-cd0b-4c0d-b71e-631922d34a56 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:10.498950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3d38671e-cd0b-4c0d-b71e-631922d34a56 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:10.499571 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3d38671e-cd0b-4c0d-b71e-631922d34a56 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:10.555768 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e7b106d8-94cd-4517-886f-a238ec1f2b1e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:10.568243 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e7b106d8-94cd-4517-886f-a238ec1f2b1e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.224459 Jul 12 03:52:10.568788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 197/383] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:10 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:10.616768 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-74dec5e9-d159-4edd-97ac-c8dd81153010 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:10.617377 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-74dec5e9-d159-4edd-97ac-c8dd81153010 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:10.623551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-74dec5e9-d159-4edd-97ac-c8dd81153010 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:10.624026 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-74dec5e9-d159-4edd-97ac-c8dd81153010 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:10.625010 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-74dec5e9-d159-4edd-97ac-c8dd81153010 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:10.625526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-74dec5e9-d159-4edd-97ac-c8dd81153010 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:10.670237 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3d38671e-cd0b-4c0d-b71e-631922d34a56 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:10.677939 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3d38671e-cd0b-4c0d-b71e-631922d34a56 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1498 microversion: 2.1 time: 0.196001 Jul 12 03:52:10.678614 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 187/384] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:10 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1498 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:10.764140 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-74dec5e9-d159-4edd-97ac-c8dd81153010 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:10.772375 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-74dec5e9-d159-4edd-97ac-c8dd81153010 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.159469 Jul 12 03:52:10.772917 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 198/385] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:10 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:11.435734 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9ea32c44-ee6c-4c18-8ded-3579354f5cf9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:11.436272 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9ea32c44-ee6c-4c18-8ded-3579354f5cf9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:11.443408 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9ea32c44-ee6c-4c18-8ded-3579354f5cf9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:11.443849 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9ea32c44-ee6c-4c18-8ded-3579354f5cf9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:11.444641 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9ea32c44-ee6c-4c18-8ded-3579354f5cf9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:11.445099 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9ea32c44-ee6c-4c18-8ded-3579354f5cf9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:11.469728 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9ea32c44-ee6c-4c18-8ded-3579354f5cf9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:52:11.553295 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9ea32c44-ee6c-4c18-8ded-3579354f5cf9 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 204 len: 0 microversion: 2.1 time: 0.121179 Jul 12 03:52:11.554398 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 188/386] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:52:11 2022] DELETE /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:52:11.563767 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-37af95f8-6fa5-452d-8f83-a217ef57ee14 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:11.564415 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-37af95f8-6fa5-452d-8f83-a217ef57ee14 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:11.572445 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-37af95f8-6fa5-452d-8f83-a217ef57ee14 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:11.572893 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-37af95f8-6fa5-452d-8f83-a217ef57ee14 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:11.573825 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-37af95f8-6fa5-452d-8f83-a217ef57ee14 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:11.577185 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-37af95f8-6fa5-452d-8f83-a217ef57ee14 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:11.585609 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6a4fe9e7-9de8-4a1e-9923-a45ad41a3365 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:11.586301 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6a4fe9e7-9de8-4a1e-9923-a45ad41a3365 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:11.592337 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a4fe9e7-9de8-4a1e-9923-a45ad41a3365 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:11.592781 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a4fe9e7-9de8-4a1e-9923-a45ad41a3365 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:11.593537 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a4fe9e7-9de8-4a1e-9923-a45ad41a3365 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:11.593969 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a4fe9e7-9de8-4a1e-9923-a45ad41a3365 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:11.720860 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-37af95f8-6fa5-452d-8f83-a217ef57ee14 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:11.730959 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-37af95f8-6fa5-452d-8f83-a217ef57ee14 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1504 microversion: 2.1 time: 0.172302 Jul 12 03:52:11.731446 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 199/387] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:11 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:11.732372 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6a4fe9e7-9de8-4a1e-9923-a45ad41a3365 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:11.742058 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6a4fe9e7-9de8-4a1e-9923-a45ad41a3365 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.160735 Jul 12 03:52:11.742973 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 189/388] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:11 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:11.788964 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0c921803-ee4f-4a63-8bf8-7a68f0df5a9f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:11.789577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0c921803-ee4f-4a63-8bf8-7a68f0df5a9f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:11.795914 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0c921803-ee4f-4a63-8bf8-7a68f0df5a9f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:11.796500 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0c921803-ee4f-4a63-8bf8-7a68f0df5a9f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:11.797253 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0c921803-ee4f-4a63-8bf8-7a68f0df5a9f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:11.797714 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0c921803-ee4f-4a63-8bf8-7a68f0df5a9f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:11.928954 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0c921803-ee4f-4a63-8bf8-7a68f0df5a9f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:11.936686 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0c921803-ee4f-4a63-8bf8-7a68f0df5a9f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.151762 Jul 12 03:52:11.937255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 200/389] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:11 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:12.748666 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fce8289c-5ba2-4825-8348-ca52436ec3fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:12.749310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-fce8289c-5ba2-4825-8348-ca52436ec3fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:12.757726 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fce8289c-5ba2-4825-8348-ca52436ec3fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:12.758133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fce8289c-5ba2-4825-8348-ca52436ec3fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:12.759085 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fce8289c-5ba2-4825-8348-ca52436ec3fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:12.759621 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-3baffe44-3f72-4adf-b509-c0c3ca079818 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:12.760078 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fce8289c-5ba2-4825-8348-ca52436ec3fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:12.760374 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-3baffe44-3f72-4adf-b509-c0c3ca079818 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:12.767025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3baffe44-3f72-4adf-b509-c0c3ca079818 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:12.767481 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3baffe44-3f72-4adf-b509-c0c3ca079818 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:12.768286 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3baffe44-3f72-4adf-b509-c0c3ca079818 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:12.768724 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3baffe44-3f72-4adf-b509-c0c3ca079818 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:12.907054 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-fce8289c-5ba2-4825-8348-ca52436ec3fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:12.909152 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-3baffe44-3f72-4adf-b509-c0c3ca079818 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:12.916846 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-3baffe44-3f72-4adf-b509-c0c3ca079818 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1371 microversion: 2.1 time: 0.161440 Jul 12 03:52:12.917492 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 201/390] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:12 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:12.926079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-fce8289c-5ba2-4825-8348-ca52436ec3fa tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1504 microversion: 2.1 time: 0.180894 Jul 12 03:52:12.926079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 190/391] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:12 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:12.953606 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e2c255b2-44e3-4bb1-a753-4b23f8a2fa94 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:12.954218 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e2c255b2-44e3-4bb1-a753-4b23f8a2fa94 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:12.960484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e2c255b2-44e3-4bb1-a753-4b23f8a2fa94 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:12.960934 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e2c255b2-44e3-4bb1-a753-4b23f8a2fa94 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:12.961708 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e2c255b2-44e3-4bb1-a753-4b23f8a2fa94 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:12.962177 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e2c255b2-44e3-4bb1-a753-4b23f8a2fa94 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:12.966388 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:13.098455 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e2c255b2-44e3-4bb1-a753-4b23f8a2fa94 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:13.106700 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e2c255b2-44e3-4bb1-a753-4b23f8a2fa94 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.157044 Jul 12 03:52:13.107249 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 202/392] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:12 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:13.934053 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c4077cd2-1221-4517-83f3-1094716efc38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:13.935319 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c4077cd2-1221-4517-83f3-1094716efc38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:13.943418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-42cc8526-e275-4e51-ba7a-f0a7f2f5a442 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:13.944033 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-42cc8526-e275-4e51-ba7a-f0a7f2f5a442 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:13.951592 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-42cc8526-e275-4e51-ba7a-f0a7f2f5a442 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:13.952065 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-42cc8526-e275-4e51-ba7a-f0a7f2f5a442 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:13.952841 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-42cc8526-e275-4e51-ba7a-f0a7f2f5a442 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:13.953273 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-42cc8526-e275-4e51-ba7a-f0a7f2f5a442 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:13.962162 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c4077cd2-1221-4517-83f3-1094716efc38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:13.962162 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c4077cd2-1221-4517-83f3-1094716efc38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:13.962162 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c4077cd2-1221-4517-83f3-1094716efc38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:13.962162 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c4077cd2-1221-4517-83f3-1094716efc38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:14.111661 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c4077cd2-1221-4517-83f3-1094716efc38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:14.120732 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c4077cd2-1221-4517-83f3-1094716efc38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1565 microversion: 2.1 time: 0.190594 Jul 12 03:52:14.121573 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 191/393] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:13 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1565 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:14.121850 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-42cc8526-e275-4e51-ba7a-f0a7f2f5a442 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:14.128281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-424043aa-893d-4d07-a021-5923087012a0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:14.129482 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-424043aa-893d-4d07-a021-5923087012a0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:14.135437 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-42cc8526-e275-4e51-ba7a-f0a7f2f5a442 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1504 microversion: 2.1 time: 0.195875 Jul 12 03:52:14.135895 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-424043aa-893d-4d07-a021-5923087012a0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:14.136430 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 203/394] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:13 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:14.136789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-424043aa-893d-4d07-a021-5923087012a0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:14.137561 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-424043aa-893d-4d07-a021-5923087012a0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:14.138205 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-424043aa-893d-4d07-a021-5923087012a0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:14.141975 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-894ff1ca-9edd-4b57-ae48-84b32b15dffd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:14.142556 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-894ff1ca-9edd-4b57-ae48-84b32b15dffd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:14.148879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-894ff1ca-9edd-4b57-ae48-84b32b15dffd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:14.149324 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-894ff1ca-9edd-4b57-ae48-84b32b15dffd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:14.150113 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-894ff1ca-9edd-4b57-ae48-84b32b15dffd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:14.150711 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-894ff1ca-9edd-4b57-ae48-84b32b15dffd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:14.234836 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-894ff1ca-9edd-4b57-ae48-84b32b15dffd tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097162 Jul 12 03:52:14.235430 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 204/395] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 03:52:14 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:52:14.298321 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-424043aa-893d-4d07-a021-5923087012a0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:14.303607 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:14.311543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-424043aa-893d-4d07-a021-5923087012a0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.187941 Jul 12 03:52:14.312154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 192/396] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:14 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:15.153303 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7856b569-6faf-4ca8-b276-56f287363676 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:15.153906 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7856b569-6faf-4ca8-b276-56f287363676 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:15.156236 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:15.170358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7856b569-6faf-4ca8-b276-56f287363676 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:15.172378 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7856b569-6faf-4ca8-b276-56f287363676 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:15.174367 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7856b569-6faf-4ca8-b276-56f287363676 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:15.175696 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7856b569-6faf-4ca8-b276-56f287363676 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:15.329511 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a4f3e001-ce0d-4ab8-bec2-49a4996ce9fa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:15.330386 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a4f3e001-ce0d-4ab8-bec2-49a4996ce9fa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:15.338151 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a4f3e001-ce0d-4ab8-bec2-49a4996ce9fa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:15.338733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a4f3e001-ce0d-4ab8-bec2-49a4996ce9fa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:15.339606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a4f3e001-ce0d-4ab8-bec2-49a4996ce9fa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:15.340164 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a4f3e001-ce0d-4ab8-bec2-49a4996ce9fa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:15.495000 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a4f3e001-ce0d-4ab8-bec2-49a4996ce9fa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:15.503564 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a4f3e001-ce0d-4ab8-bec2-49a4996ce9fa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.178450 Jul 12 03:52:15.504276 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 193/397] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:15 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:15.683887 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:15.705245 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=6 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:15.775161 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7856b569-6faf-4ca8-b276-56f287363676 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:15.794414 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7856b569-6faf-4ca8-b276-56f287363676 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1504 microversion: 2.1 time: 0.644202 Jul 12 03:52:15.795144 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 205/398] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:15 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1504 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:15.985758 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-f9301428-1adf-4de1-8eb6-37e65eb0cf74 req-9496e09d-a78e-40bc-a437-9975b14d5b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e3bc04-35b0-412b-b8d6-65165bc79e60", "tag": "a1b17494-72de-4c33-8c66-6af3d34f96b4"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:15.992709 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:15.997670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-f9301428-1adf-4de1-8eb6-37e65eb0cf74 req-9496e09d-a78e-40bc-a437-9975b14d5b85 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:15.998108 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-f9301428-1adf-4de1-8eb6-37e65eb0cf74 req-9496e09d-a78e-40bc-a437-9975b14d5b85 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:16.014624 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-f9301428-1adf-4de1-8eb6-37e65eb0cf74 req-9496e09d-a78e-40bc-a437-9975b14d5b85 service nova] Creating event network-changed:a1b17494-72de-4c33-8c66-6af3d34f96b4 for instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 on hv-cinder-84773 Jul 12 03:52:16.023454 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-f9301428-1adf-4de1-8eb6-37e65eb0cf74 req-9496e09d-a78e-40bc-a437-9975b14d5b85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042037 Jul 12 03:52:16.024108 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 194/399] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:52:16.521076 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-705c4964-61d9-4d6c-b0ac-396a794dcfe2 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:16.521836 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-705c4964-61d9-4d6c-b0ac-396a794dcfe2 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:16.529050 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-705c4964-61d9-4d6c-b0ac-396a794dcfe2 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:16.529414 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-705c4964-61d9-4d6c-b0ac-396a794dcfe2 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:16.530205 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-705c4964-61d9-4d6c-b0ac-396a794dcfe2 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:16.530639 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-705c4964-61d9-4d6c-b0ac-396a794dcfe2 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:16.666415 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-705c4964-61d9-4d6c-b0ac-396a794dcfe2 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:16.675093 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-705c4964-61d9-4d6c-b0ac-396a794dcfe2 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.158330 Jul 12 03:52:16.675673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 206/400] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:16 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:16.812279 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a61f6799-79c4-4724-9a49-25f84f3a69d2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:16.812966 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a61f6799-79c4-4724-9a49-25f84f3a69d2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:16.819838 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a61f6799-79c4-4724-9a49-25f84f3a69d2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:16.820298 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a61f6799-79c4-4724-9a49-25f84f3a69d2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:16.821057 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a61f6799-79c4-4724-9a49-25f84f3a69d2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:16.821482 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a61f6799-79c4-4724-9a49-25f84f3a69d2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:16.901817 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a61f6799-79c4-4724-9a49-25f84f3a69d2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:16.909560 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a61f6799-79c4-4724-9a49-25f84f3a69d2 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1462 microversion: 2.1 time: 0.101628 Jul 12 03:52:16.910138 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 195/401] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:16 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1462 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:17.692730 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7d8decaa-4f68-4e03-b0c9-259019ffb811 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:17.693363 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7d8decaa-4f68-4e03-b0c9-259019ffb811 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:17.700730 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7d8decaa-4f68-4e03-b0c9-259019ffb811 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:17.701199 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7d8decaa-4f68-4e03-b0c9-259019ffb811 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:17.702005 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7d8decaa-4f68-4e03-b0c9-259019ffb811 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:17.702450 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7d8decaa-4f68-4e03-b0c9-259019ffb811 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:17.921795 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7d8decaa-4f68-4e03-b0c9-259019ffb811 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:17.927994 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-abd79a0f-4578-417b-b35d-2e66b49275d8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:17.928713 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-abd79a0f-4578-417b-b35d-2e66b49275d8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:17.935198 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7d8decaa-4f68-4e03-b0c9-259019ffb811 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.246728 Jul 12 03:52:17.944784 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-abd79a0f-4578-417b-b35d-2e66b49275d8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:17.944784 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-abd79a0f-4578-417b-b35d-2e66b49275d8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:17.944784 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-abd79a0f-4578-417b-b35d-2e66b49275d8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:17.944784 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-abd79a0f-4578-417b-b35d-2e66b49275d8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:17.945183 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 207/402] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:17 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:17.990396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-abd79a0f-4578-417b-b35d-2e66b49275d8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:17.991070 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-abd79a0f-4578-417b-b35d-2e66b49275d8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:17.991763 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.objects.instance [None req-abd79a0f-4578-417b-b35d-2e66b49275d8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lazy-loading 'fault' on Instance uuid 7ee6a36c-bb82-426b-887c-4751a86c86c6 {{(pid=124435) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:52:18.008609 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2047321704", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452"}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:18.061772 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-abd79a0f-4578-417b-b35d-2e66b49275d8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea01587de8f4d5584d1b12ef042d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e33bfd157c64f8688b9720d80a3a8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:18.071872 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-abd79a0f-4578-417b-b35d-2e66b49275d8 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 200 len: 1304 microversion: 2.1 time: 0.147794 Jul 12 03:52:18.073548 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 196/403] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:17 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:18.078515 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-4f2c6a1a-f606-4a4e-a367-aea3a50184e2 req-5feb1b8d-921a-455b-9f8d-3964c30e7a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee6a36c-bb82-426b-887c-4751a86c86c6", "name": "network-vif-deleted", "tag": "86e763d9-f470-4437-a522-b77fc1d939bf"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:18.087081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-4f2c6a1a-f606-4a4e-a367-aea3a50184e2 req-5feb1b8d-921a-455b-9f8d-3964c30e7a3e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:18.087802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-4f2c6a1a-f606-4a4e-a367-aea3a50184e2 req-5feb1b8d-921a-455b-9f8d-3964c30e7a3e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:18.088611 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.network.neutron [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] validate_networks() for None {{(pid=124434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:52:18.101151 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-4f2c6a1a-f606-4a4e-a367-aea3a50184e2 req-5feb1b8d-921a-455b-9f8d-3964c30e7a3e service nova] Creating event network-vif-deleted:86e763d9-f470-4437-a522-b77fc1d939bf for instance 7ee6a36c-bb82-426b-887c-4751a86c86c6 on hv-cinder-84773 Jul 12 03:52:18.106114 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-4f2c6a1a-f606-4a4e-a367-aea3a50184e2 req-5feb1b8d-921a-455b-9f8d-3964c30e7a3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031300 Jul 12 03:52:18.106726 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 197/404] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:52:18.371379 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Flavor limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:52:18.371765 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Image limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:52:18.372259 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Flavor pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:52:18.372663 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Image pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:52:18.373067 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:52:18.382746 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:18.383201 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:18.384020 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:18.384471 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:18.401935 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Getting quotas for project 09f7e3cc59e14a0885a761c4be5e898f. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:52:18.405897 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Getting quotas for user 2ca0aea94b944212bc47c30f28265de0 and project 09f7e3cc59e14a0885a761c4be5e898f. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:52:18.416714 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Going to run 1 instances... {{(pid=124434) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:52:18.418973 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:52:18.467594 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-944d078c-c56b-40e6-8202-d3db1a4b885e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.463370 Jul 12 03:52:18.468388 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 208/405] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:52:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 03:52:18.478961 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-13e129f6-d448-42c5-a683-38b423ddd0de tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:18.479649 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-13e129f6-d448-42c5-a683-38b423ddd0de tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:18.551226 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-13e129f6-d448-42c5-a683-38b423ddd0de tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:18.563385 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-13e129f6-d448-42c5-a683-38b423ddd0de tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1215 microversion: 2.1 time: 0.088856 Jul 12 03:52:18.564266 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 198/406] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:18 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:18.954056 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f0897b6f-e70a-419a-b21f-6c5898b653cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:18.954752 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f0897b6f-e70a-419a-b21f-6c5898b653cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:18.962420 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f0897b6f-e70a-419a-b21f-6c5898b653cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:18.963112 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f0897b6f-e70a-419a-b21f-6c5898b653cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:18.963848 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f0897b6f-e70a-419a-b21f-6c5898b653cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:18.965113 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f0897b6f-e70a-419a-b21f-6c5898b653cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:19.090611 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-21a3db40-789f-4ded-81ab-fe372f705dd5 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:19.091848 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-21a3db40-789f-4ded-81ab-fe372f705dd5 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] [instance: 7ee6a36c-bb82-426b-887c-4751a86c86c6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:19.099499 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-21a3db40-789f-4ded-81ab-fe372f705dd5 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:19.099949 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-21a3db40-789f-4ded-81ab-fe372f705dd5 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:19.100748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-21a3db40-789f-4ded-81ab-fe372f705dd5 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:19.101302 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-21a3db40-789f-4ded-81ab-fe372f705dd5 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:19.109310 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f0897b6f-e70a-419a-b21f-6c5898b653cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:19.118577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f0897b6f-e70a-419a-b21f-6c5898b653cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.169817 Jul 12 03:52:19.119779 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 209/407] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:18 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:19.124079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-21a3db40-789f-4ded-81ab-fe372f705dd5 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] HTTP exception thrown: Instance 7ee6a36c-bb82-426b-887c-4751a86c86c6 could not be found. Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-21a3db40-789f-4ded-81ab-fe372f705dd5 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Request method failure captured: Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 HTTP/1.1 Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO-vEVHHQtT-5UiS36E8kMv7P5kEH9zIrAmKdTKKq8xg8hlm7uRH_ncdJJ4PU3aUrqYIrZWDiZ91dlzUNRQS2XR1qjUiWIKqqFMPbYL0Qn9bWM7pHVLVryeE7QRdifLl2Vy5n4Gf_WPVvOl2yANBo78toRKPi-H0w3_pLZ9rRKREgBU Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 3e33bfd157c64f8688b9720d80a3a8af Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-VolumesActionsTest-1789779712 Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:52:19.125788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:52:19.127310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e33bfd157c64f8688b9720d80a3a8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e33bfd157c64f8688b9720d80a3a8af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e33bfd157c64f8688b9720d80a3a8af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e33bfd157c64f8688b9720d80a3a8af"}]}] Jul 12 03:52:19.127310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-VolumesActionsTest-1789779712 Jul 12 03:52:19.127310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 3e33bfd157c64f8688b9720d80a3a8af Jul 12 03:52:19.127310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-VolumesActionsTest-1789779712 Jul 12 03:52:19.127310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-VolumesActionsTest-1789779712-project Jul 12 03:52:19.127310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:52:19.127310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:52:19.127310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 2ea01587de8f4d5584d1b12ef042d421 Jul 12 03:52:19.127310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-VolumesActionsTest-1789779712-project Jul 12 03:52:19.127310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 03:52:19.127310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance 7ee6a36c-bb82-426b-887c-4751a86c86c6 could not be found. Jul 12 03:52:19.127310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': '7ee6a36c-bb82-426b-887c-4751a86c86c6'} Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee6a36c-bb82-426b-887c-4751a86c86c6 could not be found. Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:52:19.128206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee6a36c-bb82-426b-887c-4751a86c86c6 could not be found. Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee6a36c-bb82-426b-887c-4751a86c86c6 could not be found. Jul 12 03:52:19.129792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:52:19.131067 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-21a3db40-789f-4ded-81ab-fe372f705dd5 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] Returning 404 to user: Instance 7ee6a36c-bb82-426b-887c-4751a86c86c6 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:52:19.131067 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-21a3db40-789f-4ded-81ab-fe372f705dd5 tempest-VolumesActionsTest-1789779712 tempest-VolumesActionsTest-1789779712-project] 10.222.0.20 "GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6" status: 404 len: 111 microversion: 2.1 time: 0.040693 Jul 12 03:52:19.132652 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 199/408] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:19 2022] GET /compute/v2.1/servers/7ee6a36c-bb82-426b-887c-4751a86c86c6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 03:52:19.580518 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c6790a06-65b2-40e3-b870-c9a12f56e249 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:19.581132 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c6790a06-65b2-40e3-b870-c9a12f56e249 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:19.587357 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6790a06-65b2-40e3-b870-c9a12f56e249 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:19.587806 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6790a06-65b2-40e3-b870-c9a12f56e249 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:19.588598 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6790a06-65b2-40e3-b870-c9a12f56e249 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:19.589032 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6790a06-65b2-40e3-b870-c9a12f56e249 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:19.659953 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c6790a06-65b2-40e3-b870-c9a12f56e249 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:19.669493 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c6790a06-65b2-40e3-b870-c9a12f56e249 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1267 microversion: 2.1 time: 0.093064 Jul 12 03:52:19.670351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 210/409] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:19 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:20.138789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3a9ec433-ee6b-49ef-ac25-790caa1f9344 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:20.140591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3a9ec433-ee6b-49ef-ac25-790caa1f9344 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:20.149654 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3a9ec433-ee6b-49ef-ac25-790caa1f9344 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:20.150108 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3a9ec433-ee6b-49ef-ac25-790caa1f9344 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:20.151075 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3a9ec433-ee6b-49ef-ac25-790caa1f9344 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:20.151514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3a9ec433-ee6b-49ef-ac25-790caa1f9344 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:20.333862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3a9ec433-ee6b-49ef-ac25-790caa1f9344 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:20.341792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3a9ec433-ee6b-49ef-ac25-790caa1f9344 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.208093 Jul 12 03:52:20.342455 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 200/410] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:20 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:20.686963 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c5742758-b765-44a8-9ce4-72efa1972cd5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:20.687526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c5742758-b765-44a8-9ce4-72efa1972cd5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:20.694605 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c5742758-b765-44a8-9ce4-72efa1972cd5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:20.695044 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c5742758-b765-44a8-9ce4-72efa1972cd5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:20.695867 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c5742758-b765-44a8-9ce4-72efa1972cd5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:20.696355 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c5742758-b765-44a8-9ce4-72efa1972cd5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:20.844489 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c5742758-b765-44a8-9ce4-72efa1972cd5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:20.852646 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c5742758-b765-44a8-9ce4-72efa1972cd5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.169582 Jul 12 03:52:20.853238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 211/411] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:20 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:21.359092 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0e62b5d3-ce14-4289-9635-dcc101b85f38 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:21.359836 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0e62b5d3-ce14-4289-9635-dcc101b85f38 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:21.366310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0e62b5d3-ce14-4289-9635-dcc101b85f38 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:21.366767 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0e62b5d3-ce14-4289-9635-dcc101b85f38 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:21.367619 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0e62b5d3-ce14-4289-9635-dcc101b85f38 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:21.368063 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0e62b5d3-ce14-4289-9635-dcc101b85f38 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:21.602473 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0e62b5d3-ce14-4289-9635-dcc101b85f38 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:21.610304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0e62b5d3-ce14-4289-9635-dcc101b85f38 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.255539 Jul 12 03:52:21.610881 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 201/412] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:21 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:21.870038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-fc0c8842-93ec-4162-a87f-488aeb6be1e2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:21.870730 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-fc0c8842-93ec-4162-a87f-488aeb6be1e2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:21.877512 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fc0c8842-93ec-4162-a87f-488aeb6be1e2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:21.878045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fc0c8842-93ec-4162-a87f-488aeb6be1e2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:21.878816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fc0c8842-93ec-4162-a87f-488aeb6be1e2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:21.879411 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fc0c8842-93ec-4162-a87f-488aeb6be1e2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:21.943265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-95ff1dbf-ca12-4b19-873c-c177a7e90035 req-6be0b913-1323-46a9-b300-0bee491cf466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ae0d05-6400-4af2-88f9-d3553f837de5", "tag": "1ff2a7cb-44b1-4570-b48d-9beb05f9e1d2"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:21.961874 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-95ff1dbf-ca12-4b19-873c-c177a7e90035 req-6be0b913-1323-46a9-b300-0bee491cf466 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:21.962600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-95ff1dbf-ca12-4b19-873c-c177a7e90035 req-6be0b913-1323-46a9-b300-0bee491cf466 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:21.975035 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-95ff1dbf-ca12-4b19-873c-c177a7e90035 req-6be0b913-1323-46a9-b300-0bee491cf466 service nova] Creating event network-changed:1ff2a7cb-44b1-4570-b48d-9beb05f9e1d2 for instance 62ae0d05-6400-4af2-88f9-d3553f837de5 on hv-cinder-84773 Jul 12 03:52:21.980339 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-95ff1dbf-ca12-4b19-873c-c177a7e90035 req-6be0b913-1323-46a9-b300-0bee491cf466 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042813 Jul 12 03:52:21.980942 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 202/413] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:52:22.040120 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-fc0c8842-93ec-4162-a87f-488aeb6be1e2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:22.047811 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-fc0c8842-93ec-4162-a87f-488aeb6be1e2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.181874 Jul 12 03:52:22.048462 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 212/414] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:21 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:22.627702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-29f80b34-c60e-48d9-96c4-d7c173f7cbc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:22.628440 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-29f80b34-c60e-48d9-96c4-d7c173f7cbc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:22.635305 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-29f80b34-c60e-48d9-96c4-d7c173f7cbc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:22.635753 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-29f80b34-c60e-48d9-96c4-d7c173f7cbc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:22.636567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-29f80b34-c60e-48d9-96c4-d7c173f7cbc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:22.637059 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-29f80b34-c60e-48d9-96c4-d7c173f7cbc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:22.775082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-29f80b34-c60e-48d9-96c4-d7c173f7cbc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:22.783178 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-29f80b34-c60e-48d9-96c4-d7c173f7cbc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.159733 Jul 12 03:52:22.783759 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 203/415] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:22 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:23.065146 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-230ddc09-ad33-4401-beba-3989a22e35a5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:23.065801 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-230ddc09-ad33-4401-beba-3989a22e35a5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:23.072812 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-230ddc09-ad33-4401-beba-3989a22e35a5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:23.073265 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-230ddc09-ad33-4401-beba-3989a22e35a5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:23.074029 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-230ddc09-ad33-4401-beba-3989a22e35a5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:23.074464 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-230ddc09-ad33-4401-beba-3989a22e35a5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:23.210883 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-230ddc09-ad33-4401-beba-3989a22e35a5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:23.222751 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-230ddc09-ad33-4401-beba-3989a22e35a5 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.161130 Jul 12 03:52:23.223442 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 213/416] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:23 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:23.804292 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ae6c648c-39d1-47f1-9715-341f21a640ae tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:23.805165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ae6c648c-39d1-47f1-9715-341f21a640ae tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:23.815417 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae6c648c-39d1-47f1-9715-341f21a640ae tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:23.816211 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae6c648c-39d1-47f1-9715-341f21a640ae tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:23.817456 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae6c648c-39d1-47f1-9715-341f21a640ae tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:23.818166 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae6c648c-39d1-47f1-9715-341f21a640ae tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:23.952723 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ae6c648c-39d1-47f1-9715-341f21a640ae tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:23.960731 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ae6c648c-39d1-47f1-9715-341f21a640ae tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.163021 Jul 12 03:52:23.961311 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 204/417] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:23 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:24.242342 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7b2f58cd-6ef4-488d-8fc5-130d2a3ef77f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:24.243211 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7b2f58cd-6ef4-488d-8fc5-130d2a3ef77f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:24.251212 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7b2f58cd-6ef4-488d-8fc5-130d2a3ef77f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:24.251746 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7b2f58cd-6ef4-488d-8fc5-130d2a3ef77f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:24.252639 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7b2f58cd-6ef4-488d-8fc5-130d2a3ef77f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:24.253123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7b2f58cd-6ef4-488d-8fc5-130d2a3ef77f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:24.395241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7b2f58cd-6ef4-488d-8fc5-130d2a3ef77f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:24.406580 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7b2f58cd-6ef4-488d-8fc5-130d2a3ef77f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.169751 Jul 12 03:52:24.407085 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 214/418] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:24 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:24.977751 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3b04a5a4-b340-435f-94ff-ed47976d5ee9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:24.978332 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3b04a5a4-b340-435f-94ff-ed47976d5ee9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:24.986370 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3b04a5a4-b340-435f-94ff-ed47976d5ee9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:24.986983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3b04a5a4-b340-435f-94ff-ed47976d5ee9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:24.988119 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3b04a5a4-b340-435f-94ff-ed47976d5ee9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:24.988699 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3b04a5a4-b340-435f-94ff-ed47976d5ee9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:25.123740 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3b04a5a4-b340-435f-94ff-ed47976d5ee9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:25.131653 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3b04a5a4-b340-435f-94ff-ed47976d5ee9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.157849 Jul 12 03:52:25.132228 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 205/419] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:24 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:25.424529 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7330e5ac-4a93-4939-b227-2ab2ba0c5c1e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:25.425182 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7330e5ac-4a93-4939-b227-2ab2ba0c5c1e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:25.433128 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7330e5ac-4a93-4939-b227-2ab2ba0c5c1e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:25.433673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7330e5ac-4a93-4939-b227-2ab2ba0c5c1e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:25.434531 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7330e5ac-4a93-4939-b227-2ab2ba0c5c1e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:25.435131 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7330e5ac-4a93-4939-b227-2ab2ba0c5c1e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:25.578236 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7330e5ac-4a93-4939-b227-2ab2ba0c5c1e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:25.585676 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7330e5ac-4a93-4939-b227-2ab2ba0c5c1e tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.165538 Jul 12 03:52:25.586238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 215/420] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:25 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:26.153196 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-145c2a6e-816e-418f-a0c4-16d9e3723ddc tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:26.154197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-145c2a6e-816e-418f-a0c4-16d9e3723ddc tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:26.164815 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-145c2a6e-816e-418f-a0c4-16d9e3723ddc tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:26.165610 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-145c2a6e-816e-418f-a0c4-16d9e3723ddc tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:26.166654 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-145c2a6e-816e-418f-a0c4-16d9e3723ddc tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:26.167093 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-145c2a6e-816e-418f-a0c4-16d9e3723ddc tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:26.302702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-145c2a6e-816e-418f-a0c4-16d9e3723ddc tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:26.312503 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-145c2a6e-816e-418f-a0c4-16d9e3723ddc tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.166260 Jul 12 03:52:26.313151 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 206/421] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:26 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:26.604785 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-68d4a5cf-c7fe-4653-a543-448c8bf5d44a tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:26.605400 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-68d4a5cf-c7fe-4653-a543-448c8bf5d44a tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:26.612778 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-68d4a5cf-c7fe-4653-a543-448c8bf5d44a tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:26.613342 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-68d4a5cf-c7fe-4653-a543-448c8bf5d44a tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:26.614185 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-68d4a5cf-c7fe-4653-a543-448c8bf5d44a tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:26.614610 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-68d4a5cf-c7fe-4653-a543-448c8bf5d44a tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:26.745387 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-68d4a5cf-c7fe-4653-a543-448c8bf5d44a tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:26.755141 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-68d4a5cf-c7fe-4653-a543-448c8bf5d44a tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.155960 Jul 12 03:52:26.755704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 216/422] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:26 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:27.330096 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1c6ac640-2efb-411d-a1dc-bcc8e74290a4 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:27.331327 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1c6ac640-2efb-411d-a1dc-bcc8e74290a4 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:27.338001 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c6ac640-2efb-411d-a1dc-bcc8e74290a4 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:27.338459 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c6ac640-2efb-411d-a1dc-bcc8e74290a4 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:27.339228 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c6ac640-2efb-411d-a1dc-bcc8e74290a4 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:27.339665 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c6ac640-2efb-411d-a1dc-bcc8e74290a4 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:27.483576 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1c6ac640-2efb-411d-a1dc-bcc8e74290a4 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:27.492205 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1c6ac640-2efb-411d-a1dc-bcc8e74290a4 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.166137 Jul 12 03:52:27.493121 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 207/423] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:27 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:27.772420 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a7770fc2-52a0-48a0-b611-56f43a876657 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:27.773758 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a7770fc2-52a0-48a0-b611-56f43a876657 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:27.783990 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a7770fc2-52a0-48a0-b611-56f43a876657 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:27.785075 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a7770fc2-52a0-48a0-b611-56f43a876657 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:27.786071 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a7770fc2-52a0-48a0-b611-56f43a876657 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:27.788389 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a7770fc2-52a0-48a0-b611-56f43a876657 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:27.939076 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a7770fc2-52a0-48a0-b611-56f43a876657 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:27.948381 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a7770fc2-52a0-48a0-b611-56f43a876657 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.179829 Jul 12 03:52:27.958465 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 217/424] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:27 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:28.509693 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-22048641-88e2-49ff-8399-d54eb5d8fbbb tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:28.510449 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-22048641-88e2-49ff-8399-d54eb5d8fbbb tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:28.520400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-22048641-88e2-49ff-8399-d54eb5d8fbbb tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:28.521702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-22048641-88e2-49ff-8399-d54eb5d8fbbb tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:28.523264 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-22048641-88e2-49ff-8399-d54eb5d8fbbb tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:28.524406 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-22048641-88e2-49ff-8399-d54eb5d8fbbb tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:28.573797 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:28.747501 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-22048641-88e2-49ff-8399-d54eb5d8fbbb tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:28.757230 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-22048641-88e2-49ff-8399-d54eb5d8fbbb tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.251642 Jul 12 03:52:28.764403 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 208/425] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:28 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:28.965380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4c4c874d-3686-48d8-8a15-6b90ad672eee tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:28.966580 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4c4c874d-3686-48d8-8a15-6b90ad672eee tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:28.969672 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:28.970522 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=6 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:28.977107 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4c4c874d-3686-48d8-8a15-6b90ad672eee tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:28.983373 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4c4c874d-3686-48d8-8a15-6b90ad672eee tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:28.984478 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4c4c874d-3686-48d8-8a15-6b90ad672eee tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:28.985062 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4c4c874d-3686-48d8-8a15-6b90ad672eee tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:29.149597 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4c4c874d-3686-48d8-8a15-6b90ad672eee tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:29.157805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4c4c874d-3686-48d8-8a15-6b90ad672eee tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.196267 Jul 12 03:52:29.167197 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 218/426] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:28 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:29.773753 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f4125d65-ff2d-469e-8edf-6500b2b92a0a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:29.774455 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f4125d65-ff2d-469e-8edf-6500b2b92a0a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:29.784365 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f4125d65-ff2d-469e-8edf-6500b2b92a0a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:29.784365 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f4125d65-ff2d-469e-8edf-6500b2b92a0a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:29.784653 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f4125d65-ff2d-469e-8edf-6500b2b92a0a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:29.785022 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f4125d65-ff2d-469e-8edf-6500b2b92a0a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:29.966956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f4125d65-ff2d-469e-8edf-6500b2b92a0a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:29.974940 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f4125d65-ff2d-469e-8edf-6500b2b92a0a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.205211 Jul 12 03:52:29.975536 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 209/427] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:29 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:30.175595 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1ede5358-5e70-4749-8010-659f4aad060b tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:30.176301 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1ede5358-5e70-4749-8010-659f4aad060b tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:30.183114 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1ede5358-5e70-4749-8010-659f4aad060b tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:30.183568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1ede5358-5e70-4749-8010-659f4aad060b tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:30.184364 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1ede5358-5e70-4749-8010-659f4aad060b tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:30.184803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1ede5358-5e70-4749-8010-659f4aad060b tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:30.319906 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1ede5358-5e70-4749-8010-659f4aad060b tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:30.324440 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:30.340634 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1ede5358-5e70-4749-8010-659f4aad060b tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.169220 Jul 12 03:52:30.342900 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 219/428] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:30 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:30.949546 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-77954982-4a94-4ee1-ab80-eebcde000562 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96e0dc3a-617e-4b5b-83ea-ba2a9d953a84", "device": "/dev/sdb"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:30.952823 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-77954982-4a94-4ee1-ab80-eebcde000562 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:30.955428 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:30.961808 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-77954982-4a94-4ee1-ab80-eebcde000562 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:30.964938 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-77954982-4a94-4ee1-ab80-eebcde000562 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:30.965783 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-77954982-4a94-4ee1-ab80-eebcde000562 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:30.966225 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-77954982-4a94-4ee1-ab80-eebcde000562 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:30.993620 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-da2cd802-438e-411a-b7f6-8d3b9da994b3 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:30.994855 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-da2cd802-438e-411a-b7f6-8d3b9da994b3 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:31.002667 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da2cd802-438e-411a-b7f6-8d3b9da994b3 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:31.003680 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da2cd802-438e-411a-b7f6-8d3b9da994b3 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:31.004275 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da2cd802-438e-411a-b7f6-8d3b9da994b3 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:31.004995 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da2cd802-438e-411a-b7f6-8d3b9da994b3 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:31.165483 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-da2cd802-438e-411a-b7f6-8d3b9da994b3 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:31.174300 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-da2cd802-438e-411a-b7f6-8d3b9da994b3 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.186103 Jul 12 03:52:31.175164 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 220/429] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:30 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:31.256223 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-f76a4b3b-b38b-4e5b-aa81-333fdef8bef0 req-a063aa0e-17a4-4d6e-8417-11d2854328f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f988bb-503a-447f-a796-236af82ab9f6", "name": "network-vif-plugged", "status": "completed", "tag": "4ba9303d-bc54-4f55-bfa4-2008f5d2bd62"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:31.266115 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-f76a4b3b-b38b-4e5b-aa81-333fdef8bef0 req-a063aa0e-17a4-4d6e-8417-11d2854328f3 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:31.267459 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-f76a4b3b-b38b-4e5b-aa81-333fdef8bef0 req-a063aa0e-17a4-4d6e-8417-11d2854328f3 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:31.282929 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-f76a4b3b-b38b-4e5b-aa81-333fdef8bef0 req-a063aa0e-17a4-4d6e-8417-11d2854328f3 service nova] Creating event network-vif-plugged:4ba9303d-bc54-4f55-bfa4-2008f5d2bd62 for instance 58f988bb-503a-447f-a796-236af82ab9f6 on hv-cinder-84773 Jul 12 03:52:31.288326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-f76a4b3b-b38b-4e5b-aa81-333fdef8bef0 req-a063aa0e-17a4-4d6e-8417-11d2854328f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035870 Jul 12 03:52:31.290593 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 221/430] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:52:31.358090 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6eb14de7-c1db-4124-98da-8c92f07976e8 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:31.359045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-6eb14de7-c1db-4124-98da-8c92f07976e8 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:31.366453 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6eb14de7-c1db-4124-98da-8c92f07976e8 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:31.366953 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6eb14de7-c1db-4124-98da-8c92f07976e8 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:31.367815 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6eb14de7-c1db-4124-98da-8c92f07976e8 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:31.368238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6eb14de7-c1db-4124-98da-8c92f07976e8 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:31.505786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-6eb14de7-c1db-4124-98da-8c92f07976e8 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:31.513512 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-6eb14de7-c1db-4124-98da-8c92f07976e8 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.159912 Jul 12 03:52:31.523610 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 222/431] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:31 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:32.191833 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-37ea3d09-b75b-4f67-a790-4435fb1519ee tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:32.192495 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-37ea3d09-b75b-4f67-a790-4435fb1519ee tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:32.201316 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-37ea3d09-b75b-4f67-a790-4435fb1519ee tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:32.201777 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-37ea3d09-b75b-4f67-a790-4435fb1519ee tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:32.202572 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-37ea3d09-b75b-4f67-a790-4435fb1519ee tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:32.203005 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-37ea3d09-b75b-4f67-a790-4435fb1519ee tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:32.386391 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-37ea3d09-b75b-4f67-a790-4435fb1519ee tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:32.397358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-37ea3d09-b75b-4f67-a790-4435fb1519ee tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.209389 Jul 12 03:52:32.400067 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 223/432] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:32 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:32.532201 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c4ab6ded-fc77-430b-8e27-0acf69e482c9 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:32.532959 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c4ab6ded-fc77-430b-8e27-0acf69e482c9 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:32.539627 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4ab6ded-fc77-430b-8e27-0acf69e482c9 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:32.540137 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4ab6ded-fc77-430b-8e27-0acf69e482c9 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:32.540934 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4ab6ded-fc77-430b-8e27-0acf69e482c9 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:32.541370 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4ab6ded-fc77-430b-8e27-0acf69e482c9 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:32.736256 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c4ab6ded-fc77-430b-8e27-0acf69e482c9 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:32.749728 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c4ab6ded-fc77-430b-8e27-0acf69e482c9 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.218956 Jul 12 03:52:32.759317 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 224/433] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:32 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:33.415004 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-3c335924-eebf-4098-89fd-e92d5014bb5b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:33.415834 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-3c335924-eebf-4098-89fd-e92d5014bb5b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:33.422058 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-77954982-4a94-4ee1-ab80-eebcde000562 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "POST /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.482702 Jul 12 03:52:33.425929 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3c335924-eebf-4098-89fd-e92d5014bb5b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:33.426644 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3c335924-eebf-4098-89fd-e92d5014bb5b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:33.427651 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3c335924-eebf-4098-89fd-e92d5014bb5b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:33.428681 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3c335924-eebf-4098-89fd-e92d5014bb5b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:33.430490 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 210/434] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 03:52:30 2022] POST /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f/os-volume_attachments => generated 194 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:52:33.614258 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-3c335924-eebf-4098-89fd-e92d5014bb5b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:33.622211 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-3c335924-eebf-4098-89fd-e92d5014bb5b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.211548 Jul 12 03:52:33.624049 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 225/435] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:33 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:33.768156 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d60a8a88-ad68-4de2-8307-bf1f2a6203d1 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:33.769229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d60a8a88-ad68-4de2-8307-bf1f2a6203d1 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:33.776879 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d60a8a88-ad68-4de2-8307-bf1f2a6203d1 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:33.777684 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d60a8a88-ad68-4de2-8307-bf1f2a6203d1 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:33.778756 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d60a8a88-ad68-4de2-8307-bf1f2a6203d1 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:33.779417 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d60a8a88-ad68-4de2-8307-bf1f2a6203d1 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:33.800182 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:33.927140 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d60a8a88-ad68-4de2-8307-bf1f2a6203d1 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:33.936475 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d60a8a88-ad68-4de2-8307-bf1f2a6203d1 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.173066 Jul 12 03:52:33.939169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 211/436] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:33 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:34.639349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c30f618d-5110-4efa-833b-4cb90c9c8114 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:34.640115 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c30f618d-5110-4efa-833b-4cb90c9c8114 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:34.648814 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c30f618d-5110-4efa-833b-4cb90c9c8114 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:34.649552 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c30f618d-5110-4efa-833b-4cb90c9c8114 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:34.650408 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c30f618d-5110-4efa-833b-4cb90c9c8114 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:34.650872 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c30f618d-5110-4efa-833b-4cb90c9c8114 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:34.797361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c30f618d-5110-4efa-833b-4cb90c9c8114 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:34.805608 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c30f618d-5110-4efa-833b-4cb90c9c8114 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.170638 Jul 12 03:52:34.806144 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 226/437] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:34 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:34.954999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8701ebad-9ba9-4bb2-b37b-4889eea54b55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:34.955614 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8701ebad-9ba9-4bb2-b37b-4889eea54b55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:34.971098 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8701ebad-9ba9-4bb2-b37b-4889eea54b55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:34.971562 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8701ebad-9ba9-4bb2-b37b-4889eea54b55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:34.972378 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8701ebad-9ba9-4bb2-b37b-4889eea54b55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:34.972792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8701ebad-9ba9-4bb2-b37b-4889eea54b55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:35.163212 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8701ebad-9ba9-4bb2-b37b-4889eea54b55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:35.171863 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8701ebad-9ba9-4bb2-b37b-4889eea54b55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.220771 Jul 12 03:52:35.172485 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 212/438] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:34 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:35.759574 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-95a8aa52-e6cf-4b20-8551-167b99b101ca req-bc343610-1683-44a1-978d-437a39b871be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ae0d05-6400-4af2-88f9-d3553f837de5", "name": "network-vif-plugged", "status": "completed", "tag": "1ff2a7cb-44b1-4570-b48d-9beb05f9e1d2"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:35.769886 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-95a8aa52-e6cf-4b20-8551-167b99b101ca req-bc343610-1683-44a1-978d-437a39b871be service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:35.770940 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-95a8aa52-e6cf-4b20-8551-167b99b101ca req-bc343610-1683-44a1-978d-437a39b871be service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:35.786948 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-95a8aa52-e6cf-4b20-8551-167b99b101ca req-bc343610-1683-44a1-978d-437a39b871be service nova] Creating event network-vif-plugged:1ff2a7cb-44b1-4570-b48d-9beb05f9e1d2 for instance 62ae0d05-6400-4af2-88f9-d3553f837de5 on hv-cinder-84773 Jul 12 03:52:35.792173 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-95a8aa52-e6cf-4b20-8551-167b99b101ca req-bc343610-1683-44a1-978d-437a39b871be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036455 Jul 12 03:52:35.793254 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 227/439] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:52:35.822952 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-883e9f33-7b4d-4987-a4a2-de0c17b4e5cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:35.824205 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-883e9f33-7b4d-4987-a4a2-de0c17b4e5cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:35.835530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-883e9f33-7b4d-4987-a4a2-de0c17b4e5cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:35.837786 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-883e9f33-7b4d-4987-a4a2-de0c17b4e5cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:35.840569 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-883e9f33-7b4d-4987-a4a2-de0c17b4e5cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:35.841726 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-883e9f33-7b4d-4987-a4a2-de0c17b4e5cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:36.005830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-883e9f33-7b4d-4987-a4a2-de0c17b4e5cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:36.015174 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-883e9f33-7b4d-4987-a4a2-de0c17b4e5cd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1265 microversion: 2.1 time: 0.196499 Jul 12 03:52:36.015763 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 213/440] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:35 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:36.189893 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5298ad11-1c7c-484b-939c-b9b48f3fc14c tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:36.190618 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5298ad11-1c7c-484b-939c-b9b48f3fc14c tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:36.197306 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5298ad11-1c7c-484b-939c-b9b48f3fc14c tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:36.197690 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5298ad11-1c7c-484b-939c-b9b48f3fc14c tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:36.198448 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5298ad11-1c7c-484b-939c-b9b48f3fc14c tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:36.198877 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5298ad11-1c7c-484b-939c-b9b48f3fc14c tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:36.337228 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5298ad11-1c7c-484b-939c-b9b48f3fc14c tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:36.345861 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5298ad11-1c7c-484b-939c-b9b48f3fc14c tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.160240 Jul 12 03:52:36.346433 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 228/441] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:36 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:37.033899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e87fd585-a13d-4af5-b19e-45b500754fc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:37.035211 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e87fd585-a13d-4af5-b19e-45b500754fc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:37.041982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e87fd585-a13d-4af5-b19e-45b500754fc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:37.042520 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e87fd585-a13d-4af5-b19e-45b500754fc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:37.043515 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e87fd585-a13d-4af5-b19e-45b500754fc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:37.044026 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e87fd585-a13d-4af5-b19e-45b500754fc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:37.198766 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e87fd585-a13d-4af5-b19e-45b500754fc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:37.208947 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e87fd585-a13d-4af5-b19e-45b500754fc7 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1453 microversion: 2.1 time: 0.180047 Jul 12 03:52:37.209865 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 214/442] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:37 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:37.228774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-bf13dad0-373c-483e-9d84-893b88a369c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:37.229852 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-bf13dad0-373c-483e-9d84-893b88a369c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:37.238991 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bf13dad0-373c-483e-9d84-893b88a369c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:37.239651 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bf13dad0-373c-483e-9d84-893b88a369c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:37.240774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bf13dad0-373c-483e-9d84-893b88a369c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:37.241341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bf13dad0-373c-483e-9d84-893b88a369c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:37.364162 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9dd173dc-934a-4ea1-a2e9-df77b1429a8f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:37.365679 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9dd173dc-934a-4ea1-a2e9-df77b1429a8f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:37.375265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9dd173dc-934a-4ea1-a2e9-df77b1429a8f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:37.375717 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9dd173dc-934a-4ea1-a2e9-df77b1429a8f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:37.376740 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9dd173dc-934a-4ea1-a2e9-df77b1429a8f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:37.377387 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9dd173dc-934a-4ea1-a2e9-df77b1429a8f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:37.415004 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-bf13dad0-373c-483e-9d84-893b88a369c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:37.433267 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-bf13dad0-373c-483e-9d84-893b88a369c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1453 microversion: 2.1 time: 0.210441 Jul 12 03:52:37.435838 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 229/443] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:37 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1453 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:37.579238 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9dd173dc-934a-4ea1-a2e9-df77b1429a8f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:37.589097 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9dd173dc-934a-4ea1-a2e9-df77b1429a8f tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.230048 Jul 12 03:52:37.590463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 215/444] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:37 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:38.606340 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-868aee89-d1f2-42d1-ab61-cd07984c3f55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:38.607658 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-868aee89-d1f2-42d1-ab61-cd07984c3f55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:38.614958 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-868aee89-d1f2-42d1-ab61-cd07984c3f55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:38.615669 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-868aee89-d1f2-42d1-ab61-cd07984c3f55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:38.616689 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-868aee89-d1f2-42d1-ab61-cd07984c3f55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:38.617287 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-868aee89-d1f2-42d1-ab61-cd07984c3f55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:38.762773 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-868aee89-d1f2-42d1-ab61-cd07984c3f55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:38.777562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-868aee89-d1f2-42d1-ab61-cd07984c3f55 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1315 microversion: 2.1 time: 0.175027 Jul 12 03:52:38.778520 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 230/445] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:38 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:39.633507 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-596f08cc-70b9-4fc6-9107-238926ac85dc req-e37a6675-f61d-41cc-bec7-f8e680233610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f988bb-503a-447f-a796-236af82ab9f6", "tag": "4ba9303d-bc54-4f55-bfa4-2008f5d2bd62"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:39.647913 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-596f08cc-70b9-4fc6-9107-238926ac85dc req-e37a6675-f61d-41cc-bec7-f8e680233610 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:39.649305 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-596f08cc-70b9-4fc6-9107-238926ac85dc req-e37a6675-f61d-41cc-bec7-f8e680233610 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:39.674395 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-596f08cc-70b9-4fc6-9107-238926ac85dc req-e37a6675-f61d-41cc-bec7-f8e680233610 service nova] Creating event network-changed:4ba9303d-bc54-4f55-bfa4-2008f5d2bd62 for instance 58f988bb-503a-447f-a796-236af82ab9f6 on hv-cinder-84773 Jul 12 03:52:39.681792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-596f08cc-70b9-4fc6-9107-238926ac85dc req-e37a6675-f61d-41cc-bec7-f8e680233610 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052995 Jul 12 03:52:39.682573 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 216/446] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:52:39.795397 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f605751e-5fd0-429d-950c-e4bc98a2a938 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:39.796779 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f605751e-5fd0-429d-950c-e4bc98a2a938 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:39.812187 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f605751e-5fd0-429d-950c-e4bc98a2a938 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:39.812955 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f605751e-5fd0-429d-950c-e4bc98a2a938 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:39.813926 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f605751e-5fd0-429d-950c-e4bc98a2a938 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:39.814519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f605751e-5fd0-429d-950c-e4bc98a2a938 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:40.054771 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f605751e-5fd0-429d-950c-e4bc98a2a938 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:40.063148 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f605751e-5fd0-429d-950c-e4bc98a2a938 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1465 microversion: 2.1 time: 0.272083 Jul 12 03:52:40.065128 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 231/447] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:39 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1465 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:52:40.111140 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f23e5a3e-ec46-44d3-8c0c-3982ef0f2132 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:40.111731 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f23e5a3e-ec46-44d3-8c0c-3982ef0f2132 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:40.124622 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f23e5a3e-ec46-44d3-8c0c-3982ef0f2132 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:40.125319 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f23e5a3e-ec46-44d3-8c0c-3982ef0f2132 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:40.126269 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f23e5a3e-ec46-44d3-8c0c-3982ef0f2132 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:40.126848 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f23e5a3e-ec46-44d3-8c0c-3982ef0f2132 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:40.159863 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f23e5a3e-ec46-44d3-8c0c-3982ef0f2132 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:52:40.303132 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f23e5a3e-ec46-44d3-8c0c-3982ef0f2132 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 204 len: 0 microversion: 2.1 time: 0.194722 Jul 12 03:52:40.305000 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 217/448] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:52:40 2022] DELETE /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:52:40.313550 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-fef4b0c4-1eff-4df1-bdf3-18921ac00666 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:40.314216 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-fef4b0c4-1eff-4df1-bdf3-18921ac00666 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:40.323963 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fef4b0c4-1eff-4df1-bdf3-18921ac00666 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:40.325122 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fef4b0c4-1eff-4df1-bdf3-18921ac00666 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:40.326561 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fef4b0c4-1eff-4df1-bdf3-18921ac00666 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:40.327074 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fef4b0c4-1eff-4df1-bdf3-18921ac00666 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:40.479908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-fef4b0c4-1eff-4df1-bdf3-18921ac00666 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:40.491594 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-fef4b0c4-1eff-4df1-bdf3-18921ac00666 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1471 microversion: 2.1 time: 0.182162 Jul 12 03:52:40.501704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 232/449] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:40 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:41.510292 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-89d7e617-1018-476f-a4b4-f837fc0cabe0 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:41.511030 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-89d7e617-1018-476f-a4b4-f837fc0cabe0 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:41.518877 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-89d7e617-1018-476f-a4b4-f837fc0cabe0 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:41.519445 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-89d7e617-1018-476f-a4b4-f837fc0cabe0 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:41.520350 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-89d7e617-1018-476f-a4b4-f837fc0cabe0 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:41.520895 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-89d7e617-1018-476f-a4b4-f837fc0cabe0 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:41.679266 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-89d7e617-1018-476f-a4b4-f837fc0cabe0 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:41.688997 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-89d7e617-1018-476f-a4b4-f837fc0cabe0 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1471 microversion: 2.1 time: 0.183816 Jul 12 03:52:41.689680 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 218/450] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:41 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:42.706627 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-49551c5a-8d51-414f-9e5b-853676095264 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:42.707243 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-49551c5a-8d51-414f-9e5b-853676095264 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:42.715409 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-49551c5a-8d51-414f-9e5b-853676095264 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:42.715860 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-49551c5a-8d51-414f-9e5b-853676095264 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:42.716666 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-49551c5a-8d51-414f-9e5b-853676095264 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:42.717093 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-49551c5a-8d51-414f-9e5b-853676095264 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:42.856794 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-49551c5a-8d51-414f-9e5b-853676095264 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:42.864454 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-49551c5a-8d51-414f-9e5b-853676095264 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1471 microversion: 2.1 time: 0.161626 Jul 12 03:52:42.864983 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 233/451] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:42 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:43.881789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-71d904ef-0334-4111-a6ef-fe16303478f2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:43.882406 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-71d904ef-0334-4111-a6ef-fe16303478f2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:43.890816 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-71d904ef-0334-4111-a6ef-fe16303478f2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:43.893172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-71d904ef-0334-4111-a6ef-fe16303478f2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:43.894879 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-71d904ef-0334-4111-a6ef-fe16303478f2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:43.895518 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-71d904ef-0334-4111-a6ef-fe16303478f2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:44.375087 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-71d904ef-0334-4111-a6ef-fe16303478f2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:44.385555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-71d904ef-0334-4111-a6ef-fe16303478f2 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1471 microversion: 2.1 time: 0.508064 Jul 12 03:52:44.403586 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 219/452] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:43 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1471 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:44.638599 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-0aaf559d-314c-4d5c-a190-fd14996af37b req-5638bddf-d4fb-4a41-a6e1-48f171726c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ae0d05-6400-4af2-88f9-d3553f837de5", "name": "network-vif-deleted", "tag": "1ff2a7cb-44b1-4570-b48d-9beb05f9e1d2"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:44.664774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-0aaf559d-314c-4d5c-a190-fd14996af37b req-5638bddf-d4fb-4a41-a6e1-48f171726c67 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:44.665511 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-0aaf559d-314c-4d5c-a190-fd14996af37b req-5638bddf-d4fb-4a41-a6e1-48f171726c67 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:44.678663 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-0aaf559d-314c-4d5c-a190-fd14996af37b req-5638bddf-d4fb-4a41-a6e1-48f171726c67 service nova] Creating event network-vif-deleted:1ff2a7cb-44b1-4570-b48d-9beb05f9e1d2 for instance 62ae0d05-6400-4af2-88f9-d3553f837de5 on hv-cinder-84773 Jul 12 03:52:44.684121 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-0aaf559d-314c-4d5c-a190-fd14996af37b req-5638bddf-d4fb-4a41-a6e1-48f171726c67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049410 Jul 12 03:52:44.684874 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 234/453] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:52:45.420476 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1355dbc5-f0b8-47cd-bbd1-74657b930484 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:45.420996 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1355dbc5-f0b8-47cd-bbd1-74657b930484 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:45.428143 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1355dbc5-f0b8-47cd-bbd1-74657b930484 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:45.428687 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1355dbc5-f0b8-47cd-bbd1-74657b930484 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:45.429457 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1355dbc5-f0b8-47cd-bbd1-74657b930484 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:45.429890 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1355dbc5-f0b8-47cd-bbd1-74657b930484 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:45.461667 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1355dbc5-f0b8-47cd-bbd1-74657b930484 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:45.462111 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1355dbc5-f0b8-47cd-bbd1-74657b930484 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:45.462577 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.objects.instance [None req-1355dbc5-f0b8-47cd-bbd1-74657b930484 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lazy-loading 'fault' on Instance uuid 62ae0d05-6400-4af2-88f9-d3553f837de5 {{(pid=124435) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:52:45.528295 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1355dbc5-f0b8-47cd-bbd1-74657b930484 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca0aea94b944212bc47c30f28265de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f7e3cc59e14a0885a761c4be5e898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:45.536277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1355dbc5-f0b8-47cd-bbd1-74657b930484 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 200 len: 1305 microversion: 2.1 time: 0.120086 Jul 12 03:52:45.536875 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 220/454] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:45 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 1305 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:52:46.555264 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8ff9bc32-b900-4e55-81cf-31e0fc7b7ee6 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:46.555988 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8ff9bc32-b900-4e55-81cf-31e0fc7b7ee6 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] [instance: 62ae0d05-6400-4af2-88f9-d3553f837de5] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:46.558214 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:46.564312 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8ff9bc32-b900-4e55-81cf-31e0fc7b7ee6 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:46.564889 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8ff9bc32-b900-4e55-81cf-31e0fc7b7ee6 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:46.565635 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8ff9bc32-b900-4e55-81cf-31e0fc7b7ee6 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:46.566099 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8ff9bc32-b900-4e55-81cf-31e0fc7b7ee6 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:46.584936 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-8ff9bc32-b900-4e55-81cf-31e0fc7b7ee6 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] HTTP exception thrown: Instance 62ae0d05-6400-4af2-88f9-d3553f837de5 could not be found. Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8ff9bc32-b900-4e55-81cf-31e0fc7b7ee6 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Request method failure captured: Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 HTTP/1.1 Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO_v89zrzrqtXcMqST3BevkNIV6OQOfCQr9HCT61KSj1NFU5TD3fQ8d8uYDjMFxzM29T1QXPQN-_5egFaFQUI7Pn4OOE_8myciuLr8Sy8_HovpDjezNCzMAXZCbSnbd-JkujxadCeVGD2ImcmBEuliuArBxzYUsCx4PIcA13F-Ll958 Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 09f7e3cc59e14a0885a761c4be5e898f Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-VolumesNegativeTest-724763881 Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 03:52:46.586793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 03:52:46.588484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09f7e3cc59e14a0885a761c4be5e898f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09f7e3cc59e14a0885a761c4be5e898f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09f7e3cc59e14a0885a761c4be5e898f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09f7e3cc59e14a0885a761c4be5e898f"}]}] Jul 12 03:52:46.588484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-VolumesNegativeTest-724763881 Jul 12 03:52:46.588484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 09f7e3cc59e14a0885a761c4be5e898f Jul 12 03:52:46.588484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-VolumesNegativeTest-724763881 Jul 12 03:52:46.588484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-VolumesNegativeTest-724763881-project Jul 12 03:52:46.588484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 03:52:46.588484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 03:52:46.588484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 2ca0aea94b944212bc47c30f28265de0 Jul 12 03:52:46.588484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-VolumesNegativeTest-724763881-project Jul 12 03:52:46.588484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 03:52:46.588484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance 62ae0d05-6400-4af2-88f9-d3553f837de5 could not be found. Jul 12 03:52:46.588484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': '62ae0d05-6400-4af2-88f9-d3553f837de5'} Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ae0d05-6400-4af2-88f9-d3553f837de5 could not be found. Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:52:46.589341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ae0d05-6400-4af2-88f9-d3553f837de5 could not be found. Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ae0d05-6400-4af2-88f9-d3553f837de5 could not be found. Jul 12 03:52:46.590568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:52:46.591667 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8ff9bc32-b900-4e55-81cf-31e0fc7b7ee6 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] Returning 404 to user: Instance 62ae0d05-6400-4af2-88f9-d3553f837de5 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:52:46.591667 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8ff9bc32-b900-4e55-81cf-31e0fc7b7ee6 tempest-VolumesNegativeTest-724763881 tempest-VolumesNegativeTest-724763881-project] 10.222.0.20 "GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5" status: 404 len: 111 microversion: 2.1 time: 0.038252 Jul 12 03:52:46.591667 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 235/455] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:52:46 2022] GET /compute/v2.1/servers/62ae0d05-6400-4af2-88f9-d3553f837de5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:52:52.631937 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3358eee4-e0a1-4254-ab1a-b87df54fb2cf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:52.632551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3358eee4-e0a1-4254-ab1a-b87df54fb2cf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:52.643425 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3358eee4-e0a1-4254-ab1a-b87df54fb2cf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:52.643980 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3358eee4-e0a1-4254-ab1a-b87df54fb2cf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:52.644843 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3358eee4-e0a1-4254-ab1a-b87df54fb2cf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:52.645417 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3358eee4-e0a1-4254-ab1a-b87df54fb2cf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:52.670719 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3358eee4-e0a1-4254-ab1a-b87df54fb2cf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/ips" status: 200 len: 151 microversion: 2.20 time: 0.044942 Jul 12 03:52:52.671271 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 221/456] 10.222.0.20 () {60 vars in 1288 bytes} [Tue Jul 12 03:52:52 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:52:57.709378 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-606bf53b-ec2d-4c01-b1c9-d04de4d4b109 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:52:57.710877 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-606bf53b-ec2d-4c01-b1c9-d04de4d4b109 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:57.716434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=80 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:57.717116 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:52:57.724200 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-606bf53b-ec2d-4c01-b1c9-d04de4d4b109 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:57.724650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-606bf53b-ec2d-4c01-b1c9-d04de4d4b109 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:57.725421 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-606bf53b-ec2d-4c01-b1c9-d04de4d4b109 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:57.725855 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-606bf53b-ec2d-4c01-b1c9-d04de4d4b109 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:57.749060 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-606bf53b-ec2d-4c01-b1c9-d04de4d4b109 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lazy-loading 'flavor' on Instance uuid ae771f5b-03de-46db-82fc-cd94d731405a {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:52:58.048253 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-606bf53b-ec2d-4c01-b1c9-d04de4d4b109 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "POST /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/action" status: 202 len: 0 microversion: 2.20 time: 0.347268 Jul 12 03:52:58.049000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 236/457] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jul 12 03:52:57 2022] POST /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:52:58.057267 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-418d8857-ca81-4618-8d39-7aeb5cc50865 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:58.057968 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-418d8857-ca81-4618-8d39-7aeb5cc50865 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:58.065152 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-418d8857-ca81-4618-8d39-7aeb5cc50865 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:58.065726 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-418d8857-ca81-4618-8d39-7aeb5cc50865 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:58.066588 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-418d8857-ca81-4618-8d39-7aeb5cc50865 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:58.067177 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-418d8857-ca81-4618-8d39-7aeb5cc50865 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:58.196248 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-418d8857-ca81-4618-8d39-7aeb5cc50865 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:58.204320 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-418d8857-ca81-4618-8d39-7aeb5cc50865 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:58.205774 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-418d8857-ca81-4618-8d39-7aeb5cc50865 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:58.206916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-418d8857-ca81-4618-8d39-7aeb5cc50865 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.153555 Jul 12 03:52:58.207473 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 222/458] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:52:58 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:52:59.237875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d6c525d3-0a50-44e7-a26f-05ed2029dea9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:52:59.238907 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d6c525d3-0a50-44e7-a26f-05ed2029dea9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:52:59.249371 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d6c525d3-0a50-44e7-a26f-05ed2029dea9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:59.249818 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d6c525d3-0a50-44e7-a26f-05ed2029dea9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:59.250582 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d6c525d3-0a50-44e7-a26f-05ed2029dea9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:52:59.251016 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d6c525d3-0a50-44e7-a26f-05ed2029dea9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:52:59.390631 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d6c525d3-0a50-44e7-a26f-05ed2029dea9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:59.399415 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d6c525d3-0a50-44e7-a26f-05ed2029dea9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:59.400950 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d6c525d3-0a50-44e7-a26f-05ed2029dea9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:52:59.402109 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d6c525d3-0a50-44e7-a26f-05ed2029dea9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.172443 Jul 12 03:52:59.402631 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 237/459] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:52:59 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:00.420532 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-af37e214-2b54-47eb-98af-b6cd4b468997 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:00.421142 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-af37e214-2b54-47eb-98af-b6cd4b468997 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:00.428032 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-af37e214-2b54-47eb-98af-b6cd4b468997 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:00.428507 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-af37e214-2b54-47eb-98af-b6cd4b468997 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:00.429267 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-af37e214-2b54-47eb-98af-b6cd4b468997 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:00.429698 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-af37e214-2b54-47eb-98af-b6cd4b468997 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:00.564668 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-af37e214-2b54-47eb-98af-b6cd4b468997 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:00.573380 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-af37e214-2b54-47eb-98af-b6cd4b468997 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:00.575207 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-af37e214-2b54-47eb-98af-b6cd4b468997 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:00.576680 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-af37e214-2b54-47eb-98af-b6cd4b468997 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.159974 Jul 12 03:53:00.577363 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 223/460] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:00 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:01.598977 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a4e48a74-5e4b-4f74-8e3e-ba15759a1da3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:01.599967 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a4e48a74-5e4b-4f74-8e3e-ba15759a1da3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:01.611000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a4e48a74-5e4b-4f74-8e3e-ba15759a1da3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:01.611754 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a4e48a74-5e4b-4f74-8e3e-ba15759a1da3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:01.613041 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a4e48a74-5e4b-4f74-8e3e-ba15759a1da3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:01.613519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a4e48a74-5e4b-4f74-8e3e-ba15759a1da3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:01.750974 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a4e48a74-5e4b-4f74-8e3e-ba15759a1da3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:01.760541 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a4e48a74-5e4b-4f74-8e3e-ba15759a1da3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:01.762036 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a4e48a74-5e4b-4f74-8e3e-ba15759a1da3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:01.763193 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a4e48a74-5e4b-4f74-8e3e-ba15759a1da3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.170879 Jul 12 03:53:01.763758 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 238/461] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:01 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:02.782237 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9d17f248-4bc6-4620-a347-ec01ad320c14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:02.782826 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9d17f248-4bc6-4620-a347-ec01ad320c14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:02.785380 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:53:02.791540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9d17f248-4bc6-4620-a347-ec01ad320c14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:02.792023 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9d17f248-4bc6-4620-a347-ec01ad320c14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:02.792926 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9d17f248-4bc6-4620-a347-ec01ad320c14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:02.793456 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9d17f248-4bc6-4620-a347-ec01ad320c14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:02.933153 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9d17f248-4bc6-4620-a347-ec01ad320c14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:02.942778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9d17f248-4bc6-4620-a347-ec01ad320c14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:02.944983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9d17f248-4bc6-4620-a347-ec01ad320c14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:02.946452 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9d17f248-4bc6-4620-a347-ec01ad320c14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.168715 Jul 12 03:53:02.947176 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 224/462] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:02 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:03.965276 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-48a5d06d-33b3-410a-9129-53b2b6d34d06 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:03.965915 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-48a5d06d-33b3-410a-9129-53b2b6d34d06 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:03.973243 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-48a5d06d-33b3-410a-9129-53b2b6d34d06 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:03.973692 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-48a5d06d-33b3-410a-9129-53b2b6d34d06 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:03.974463 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-48a5d06d-33b3-410a-9129-53b2b6d34d06 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:03.974897 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-48a5d06d-33b3-410a-9129-53b2b6d34d06 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:04.103568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-48a5d06d-33b3-410a-9129-53b2b6d34d06 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:04.111754 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-48a5d06d-33b3-410a-9129-53b2b6d34d06 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:04.113312 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-48a5d06d-33b3-410a-9129-53b2b6d34d06 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:04.114454 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-48a5d06d-33b3-410a-9129-53b2b6d34d06 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.153095 Jul 12 03:53:04.115007 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 239/463] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:03 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:05.137308 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-26a51b6f-2bf7-45a2-8c18-5f77503736c7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:05.138247 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-26a51b6f-2bf7-45a2-8c18-5f77503736c7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:05.147653 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-26a51b6f-2bf7-45a2-8c18-5f77503736c7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:05.148132 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-26a51b6f-2bf7-45a2-8c18-5f77503736c7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:05.148891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-26a51b6f-2bf7-45a2-8c18-5f77503736c7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:05.149356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-26a51b6f-2bf7-45a2-8c18-5f77503736c7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:05.151915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:53:05.287776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-26a51b6f-2bf7-45a2-8c18-5f77503736c7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:05.295905 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-26a51b6f-2bf7-45a2-8c18-5f77503736c7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:05.298617 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-26a51b6f-2bf7-45a2-8c18-5f77503736c7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:05.299772 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-26a51b6f-2bf7-45a2-8c18-5f77503736c7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.169108 Jul 12 03:53:05.300413 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 225/464] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:05 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:05.853952 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cdae8796-549e-49d7-b228-ae58eec01797 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:05.854537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-cdae8796-549e-49d7-b228-ae58eec01797 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:05.862426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cdae8796-549e-49d7-b228-ae58eec01797 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:05.863023 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cdae8796-549e-49d7-b228-ae58eec01797 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:05.863776 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cdae8796-549e-49d7-b228-ae58eec01797 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:05.864241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cdae8796-549e-49d7-b228-ae58eec01797 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:05.994363 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-cdae8796-549e-49d7-b228-ae58eec01797 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lazy-loading 'services' on Instance uuid 819ccee1-8d15-4186-9538-b903779cdf2f {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:53:06.119453 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cdae8796-549e-49d7-b228-ae58eec01797 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "DELETE /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f/os-volume_attachments/96e0dc3a-617e-4b5b-83ea-ba2a9d953a84" status: 202 len: 0 microversion: 2.1 time: 0.269896 Jul 12 03:53:06.120230 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 240/465] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 03:53:05 2022] DELETE /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f/os-volume_attachments/96e0dc3a-617e-4b5b-83ea-ba2a9d953a84 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:53:06.322292 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4039c2e0-f0b2-48aa-9f9c-28371d5299ef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:06.323321 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4039c2e0-f0b2-48aa-9f9c-28371d5299ef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:06.334119 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4039c2e0-f0b2-48aa-9f9c-28371d5299ef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:06.334895 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4039c2e0-f0b2-48aa-9f9c-28371d5299ef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:06.336291 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4039c2e0-f0b2-48aa-9f9c-28371d5299ef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:06.336901 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4039c2e0-f0b2-48aa-9f9c-28371d5299ef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:06.479115 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4039c2e0-f0b2-48aa-9f9c-28371d5299ef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:06.491445 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4039c2e0-f0b2-48aa-9f9c-28371d5299ef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:06.493882 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4039c2e0-f0b2-48aa-9f9c-28371d5299ef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:06.495674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4039c2e0-f0b2-48aa-9f9c-28371d5299ef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.179771 Jul 12 03:53:06.496522 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 226/466] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:06 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:07.523112 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f90729a7-3b6b-40cd-9ed4-73dfe7749022 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:07.523954 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f90729a7-3b6b-40cd-9ed4-73dfe7749022 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:07.532387 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f90729a7-3b6b-40cd-9ed4-73dfe7749022 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:07.532919 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f90729a7-3b6b-40cd-9ed4-73dfe7749022 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:07.533816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f90729a7-3b6b-40cd-9ed4-73dfe7749022 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:07.534332 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f90729a7-3b6b-40cd-9ed4-73dfe7749022 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:07.689227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f90729a7-3b6b-40cd-9ed4-73dfe7749022 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:07.699453 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f90729a7-3b6b-40cd-9ed4-73dfe7749022 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:07.701065 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f90729a7-3b6b-40cd-9ed4-73dfe7749022 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:07.702227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f90729a7-3b6b-40cd-9ed4-73dfe7749022 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.187740 Jul 12 03:53:07.702824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 241/467] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:07 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:08.312783 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4290c5a4-04ae-4cde-8f26-f63b106ac457 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:08.313341 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4290c5a4-04ae-4cde-8f26-f63b106ac457 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:08.322548 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4290c5a4-04ae-4cde-8f26-f63b106ac457 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:08.322998 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4290c5a4-04ae-4cde-8f26-f63b106ac457 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:08.324107 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4290c5a4-04ae-4cde-8f26-f63b106ac457 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:08.324645 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4290c5a4-04ae-4cde-8f26-f63b106ac457 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:08.351792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4290c5a4-04ae-4cde-8f26-f63b106ac457 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:53:08.431572 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4290c5a4-04ae-4cde-8f26-f63b106ac457 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "DELETE /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 204 len: 0 microversion: 2.1 time: 0.124584 Jul 12 03:53:08.432300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 227/468] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:53:08 2022] DELETE /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:53:08.440958 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-edf52950-c948-43b9-96b8-2d5790dfbc0d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:08.441566 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-edf52950-c948-43b9-96b8-2d5790dfbc0d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:08.447883 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-edf52950-c948-43b9-96b8-2d5790dfbc0d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:08.448362 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-edf52950-c948-43b9-96b8-2d5790dfbc0d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:08.449118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-edf52950-c948-43b9-96b8-2d5790dfbc0d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:08.449552 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-edf52950-c948-43b9-96b8-2d5790dfbc0d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:08.591357 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-edf52950-c948-43b9-96b8-2d5790dfbc0d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:08.599270 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-edf52950-c948-43b9-96b8-2d5790dfbc0d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1514 microversion: 2.1 time: 0.162166 Jul 12 03:53:08.599838 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 242/469] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:08 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:08.725386 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6f80a63c-c040-45d2-b9ce-11f9a67a7c1e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:08.726551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6f80a63c-c040-45d2-b9ce-11f9a67a7c1e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:08.736871 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6f80a63c-c040-45d2-b9ce-11f9a67a7c1e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:08.737611 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6f80a63c-c040-45d2-b9ce-11f9a67a7c1e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:08.738874 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6f80a63c-c040-45d2-b9ce-11f9a67a7c1e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:08.739588 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6f80a63c-c040-45d2-b9ce-11f9a67a7c1e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:08.875724 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6f80a63c-c040-45d2-b9ce-11f9a67a7c1e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:08.887941 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6f80a63c-c040-45d2-b9ce-11f9a67a7c1e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:08.890264 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6f80a63c-c040-45d2-b9ce-11f9a67a7c1e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:08.892401 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6f80a63c-c040-45d2-b9ce-11f9a67a7c1e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.173552 Jul 12 03:53:08.893160 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 228/470] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:08 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:09.621321 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-760977ff-0d1a-4bda-97ab-0cb8b80ce6dd tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:09.622370 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-760977ff-0d1a-4bda-97ab-0cb8b80ce6dd tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:09.633547 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-760977ff-0d1a-4bda-97ab-0cb8b80ce6dd tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:09.634293 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-760977ff-0d1a-4bda-97ab-0cb8b80ce6dd tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:09.635555 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-760977ff-0d1a-4bda-97ab-0cb8b80ce6dd tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:09.636332 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-760977ff-0d1a-4bda-97ab-0cb8b80ce6dd tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:09.789049 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-760977ff-0d1a-4bda-97ab-0cb8b80ce6dd tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:09.796769 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-760977ff-0d1a-4bda-97ab-0cb8b80ce6dd tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1514 microversion: 2.1 time: 0.182197 Jul 12 03:53:09.797342 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 243/471] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:09 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:09.911349 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-71755a9f-b4cd-4c34-b3d2-6770d84db6fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:09.911932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-71755a9f-b4cd-4c34-b3d2-6770d84db6fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:09.919029 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-71755a9f-b4cd-4c34-b3d2-6770d84db6fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:09.919483 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-71755a9f-b4cd-4c34-b3d2-6770d84db6fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:09.920281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-71755a9f-b4cd-4c34-b3d2-6770d84db6fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:09.920719 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-71755a9f-b4cd-4c34-b3d2-6770d84db6fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:10.055202 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-71755a9f-b4cd-4c34-b3d2-6770d84db6fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:10.063286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-71755a9f-b4cd-4c34-b3d2-6770d84db6fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:10.064835 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-71755a9f-b4cd-4c34-b3d2-6770d84db6fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:10.065996 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-71755a9f-b4cd-4c34-b3d2-6770d84db6fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.158796 Jul 12 03:53:10.066569 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 229/472] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:09 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:10.814409 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-78488031-7c3a-430f-9f1d-8604a3adcb46 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:10.815135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-78488031-7c3a-430f-9f1d-8604a3adcb46 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:10.822322 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78488031-7c3a-430f-9f1d-8604a3adcb46 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:10.822773 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78488031-7c3a-430f-9f1d-8604a3adcb46 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:10.823542 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78488031-7c3a-430f-9f1d-8604a3adcb46 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:10.823963 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78488031-7c3a-430f-9f1d-8604a3adcb46 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:10.964641 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-78488031-7c3a-430f-9f1d-8604a3adcb46 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:10.972622 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-78488031-7c3a-430f-9f1d-8604a3adcb46 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 200 len: 1514 microversion: 2.1 time: 0.162186 Jul 12 03:53:10.973306 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 244/473] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:10 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:11.087246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6841717b-b2c7-43fb-969e-7b5307c9c46d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:11.087862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6841717b-b2c7-43fb-969e-7b5307c9c46d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:11.095897 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6841717b-b2c7-43fb-969e-7b5307c9c46d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:11.096391 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6841717b-b2c7-43fb-969e-7b5307c9c46d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:11.097216 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6841717b-b2c7-43fb-969e-7b5307c9c46d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:11.097648 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6841717b-b2c7-43fb-969e-7b5307c9c46d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:11.141037 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-0c6bfab8-1c41-490f-9c3a-aae2573d2dba req-aec85ae0-9637-4fd5-8739-98ab61a26bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819ccee1-8d15-4186-9538-b903779cdf2f", "name": "network-vif-deleted", "tag": "0f893515-f3d7-4404-9069-2651d8e631d6"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:53:11.151591 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-0c6bfab8-1c41-490f-9c3a-aae2573d2dba req-aec85ae0-9637-4fd5-8739-98ab61a26bb5 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:11.152031 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-0c6bfab8-1c41-490f-9c3a-aae2573d2dba req-aec85ae0-9637-4fd5-8739-98ab61a26bb5 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:11.164484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-0c6bfab8-1c41-490f-9c3a-aae2573d2dba req-aec85ae0-9637-4fd5-8739-98ab61a26bb5 service nova] Creating event network-vif-deleted:0f893515-f3d7-4404-9069-2651d8e631d6 for instance 819ccee1-8d15-4186-9538-b903779cdf2f on hv-cinder-84773 Jul 12 03:53:11.169638 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-0c6bfab8-1c41-490f-9c3a-aae2573d2dba req-aec85ae0-9637-4fd5-8739-98ab61a26bb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032035 Jul 12 03:53:11.170634 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 245/474] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:53:11.241313 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6841717b-b2c7-43fb-969e-7b5307c9c46d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:11.249827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6841717b-b2c7-43fb-969e-7b5307c9c46d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:11.251348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6841717b-b2c7-43fb-969e-7b5307c9c46d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:11.252524 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6841717b-b2c7-43fb-969e-7b5307c9c46d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.170515 Jul 12 03:53:11.253110 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 230/475] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:11 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:11.994342 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9fa3f1ce-6979-405d-ad2c-fec7ee2f59e9 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:11.994978 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-9fa3f1ce-6979-405d-ad2c-fec7ee2f59e9 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: 819ccee1-8d15-4186-9538-b903779cdf2f] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:12.002251 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9fa3f1ce-6979-405d-ad2c-fec7ee2f59e9 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:12.002697 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9fa3f1ce-6979-405d-ad2c-fec7ee2f59e9 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:12.003461 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9fa3f1ce-6979-405d-ad2c-fec7ee2f59e9 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:12.003891 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9fa3f1ce-6979-405d-ad2c-fec7ee2f59e9 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:12.017815 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-9fa3f1ce-6979-405d-ad2c-fec7ee2f59e9 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] HTTP exception thrown: Instance 819ccee1-8d15-4186-9538-b903779cdf2f could not be found. Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9fa3f1ce-6979-405d-ad2c-fec7ee2f59e9 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Request method failure captured: Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f HTTP/1.1 Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO_Dt2rHA0KfAlZx-Y1yZTbJAbpkeRmf-Rt-3HWZcEYA8gZeXVKXvTtVmuVUDx9KoWs91IxfH6jVIVwWrZZ3Mdc58iFdNBa2AwJGotb7EsuKr74AFCUgt5KadmZTXFv99jvyozJoIDvvQcPYAu_LFS7K18oXvxUutJ8lWaBz-yYRP0E Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: cd2e5f7d1e2e4aa3a98bbbf89a6ec276 Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1822208826 Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 03:53:12.019428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 03:53:12.020993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cd2e5f7d1e2e4aa3a98bbbf89a6ec276"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cd2e5f7d1e2e4aa3a98bbbf89a6ec276"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd2e5f7d1e2e4aa3a98bbbf89a6ec276"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd2e5f7d1e2e4aa3a98bbbf89a6ec276"}]}] Jul 12 03:53:12.020993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-VolumesSnapshotTestJSON-1822208826 Jul 12 03:53:12.020993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: cd2e5f7d1e2e4aa3a98bbbf89a6ec276 Jul 12 03:53:12.020993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1822208826 Jul 12 03:53:12.020993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-VolumesSnapshotTestJSON-1822208826-project Jul 12 03:53:12.020993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 03:53:12.020993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 03:53:12.020993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 9e27cbb381174481ade02b228faa8fb8 Jul 12 03:53:12.020993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-VolumesSnapshotTestJSON-1822208826-project Jul 12 03:53:12.020993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 03:53:12.020993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance 819ccee1-8d15-4186-9538-b903779cdf2f could not be found. Jul 12 03:53:12.020993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': '819ccee1-8d15-4186-9538-b903779cdf2f'} Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 819ccee1-8d15-4186-9538-b903779cdf2f could not be found. Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:53:12.021786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 819ccee1-8d15-4186-9538-b903779cdf2f could not be found. Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 819ccee1-8d15-4186-9538-b903779cdf2f could not be found. Jul 12 03:53:12.023027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:53:12.024466 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9fa3f1ce-6979-405d-ad2c-fec7ee2f59e9 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Returning 404 to user: Instance 819ccee1-8d15-4186-9538-b903779cdf2f could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:53:12.024466 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9fa3f1ce-6979-405d-ad2c-fec7ee2f59e9 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f" status: 404 len: 111 microversion: 2.1 time: 0.033082 Jul 12 03:53:12.024466 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 246/476] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:11 2022] GET /compute/v2.1/servers/819ccee1-8d15-4186-9538-b903779cdf2f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:53:12.274882 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bc44ca06-4a5a-45c8-bd07-3295750df150 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:12.276058 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-bc44ca06-4a5a-45c8-bd07-3295750df150 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:12.286348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bc44ca06-4a5a-45c8-bd07-3295750df150 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:12.287034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bc44ca06-4a5a-45c8-bd07-3295750df150 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:12.288250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bc44ca06-4a5a-45c8-bd07-3295750df150 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:12.288924 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bc44ca06-4a5a-45c8-bd07-3295750df150 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:12.431109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bc44ca06-4a5a-45c8-bd07-3295750df150 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:12.440864 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bc44ca06-4a5a-45c8-bd07-3295750df150 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:12.442741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bc44ca06-4a5a-45c8-bd07-3295750df150 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:12.444478 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bc44ca06-4a5a-45c8-bd07-3295750df150 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.176210 Jul 12 03:53:12.445209 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 231/477] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:12 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:13.466218 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-565c4f6d-b836-47b3-a414-7fa20273fada tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:13.466989 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-565c4f6d-b836-47b3-a414-7fa20273fada tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:13.475536 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-565c4f6d-b836-47b3-a414-7fa20273fada tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:13.476035 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-565c4f6d-b836-47b3-a414-7fa20273fada tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:13.477012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-565c4f6d-b836-47b3-a414-7fa20273fada tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:13.477560 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-565c4f6d-b836-47b3-a414-7fa20273fada tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:13.617725 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-565c4f6d-b836-47b3-a414-7fa20273fada tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:13.629473 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-565c4f6d-b836-47b3-a414-7fa20273fada tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:13.631671 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-565c4f6d-b836-47b3-a414-7fa20273fada tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:13.633500 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-565c4f6d-b836-47b3-a414-7fa20273fada tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.172411 Jul 12 03:53:13.634167 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 247/478] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:13 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:14.661789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-faa43476-90f1-4f01-bd5e-23b1f45456a9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:14.662877 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-faa43476-90f1-4f01-bd5e-23b1f45456a9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:14.670828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-faa43476-90f1-4f01-bd5e-23b1f45456a9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:14.671273 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-faa43476-90f1-4f01-bd5e-23b1f45456a9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:14.672040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-faa43476-90f1-4f01-bd5e-23b1f45456a9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:14.672500 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-faa43476-90f1-4f01-bd5e-23b1f45456a9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:14.806832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-faa43476-90f1-4f01-bd5e-23b1f45456a9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:14.815361 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-faa43476-90f1-4f01-bd5e-23b1f45456a9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:14.816922 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-faa43476-90f1-4f01-bd5e-23b1f45456a9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:14.818077 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-faa43476-90f1-4f01-bd5e-23b1f45456a9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.163030 Jul 12 03:53:14.818620 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 232/479] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:14 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:15.837682 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b78c78c0-35b6-46c5-aed3-aaf0f692adc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:15.838307 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b78c78c0-35b6-46c5-aed3-aaf0f692adc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:15.847463 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b78c78c0-35b6-46c5-aed3-aaf0f692adc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:15.848259 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b78c78c0-35b6-46c5-aed3-aaf0f692adc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:15.849519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b78c78c0-35b6-46c5-aed3-aaf0f692adc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:15.850247 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b78c78c0-35b6-46c5-aed3-aaf0f692adc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:15.983270 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b78c78c0-35b6-46c5-aed3-aaf0f692adc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:15.991681 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b78c78c0-35b6-46c5-aed3-aaf0f692adc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:15.993224 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b78c78c0-35b6-46c5-aed3-aaf0f692adc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:15.994391 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b78c78c0-35b6-46c5-aed3-aaf0f692adc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.160901 Jul 12 03:53:15.994925 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 248/480] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:15 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:17.016433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d4f71c9d-dc45-4109-86e3-cbd40db1cecf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:17.017597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d4f71c9d-dc45-4109-86e3-cbd40db1cecf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:17.026986 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d4f71c9d-dc45-4109-86e3-cbd40db1cecf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:17.027438 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d4f71c9d-dc45-4109-86e3-cbd40db1cecf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:17.028264 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d4f71c9d-dc45-4109-86e3-cbd40db1cecf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:17.028730 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d4f71c9d-dc45-4109-86e3-cbd40db1cecf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:17.163728 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d4f71c9d-dc45-4109-86e3-cbd40db1cecf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:17.172789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d4f71c9d-dc45-4109-86e3-cbd40db1cecf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:17.174317 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d4f71c9d-dc45-4109-86e3-cbd40db1cecf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:17.175465 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d4f71c9d-dc45-4109-86e3-cbd40db1cecf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.165403 Jul 12 03:53:17.176360 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 233/481] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:17 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:18.194058 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-3becbb53-f28b-447f-b2ea-03c91cff6b67 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:18.194687 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-3becbb53-f28b-447f-b2ea-03c91cff6b67 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:18.200987 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3becbb53-f28b-447f-b2ea-03c91cff6b67 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:18.201433 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3becbb53-f28b-447f-b2ea-03c91cff6b67 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:18.202189 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3becbb53-f28b-447f-b2ea-03c91cff6b67 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:18.202619 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3becbb53-f28b-447f-b2ea-03c91cff6b67 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:18.333412 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-3becbb53-f28b-447f-b2ea-03c91cff6b67 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:18.341768 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-3becbb53-f28b-447f-b2ea-03c91cff6b67 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:18.343227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-3becbb53-f28b-447f-b2ea-03c91cff6b67 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:18.344410 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-3becbb53-f28b-447f-b2ea-03c91cff6b67 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.154246 Jul 12 03:53:18.344975 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 249/482] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:18 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:19.367441 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4408f03f-18dc-41c1-9cba-ce52857c32c0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:19.368421 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4408f03f-18dc-41c1-9cba-ce52857c32c0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:19.376361 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4408f03f-18dc-41c1-9cba-ce52857c32c0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:19.376833 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4408f03f-18dc-41c1-9cba-ce52857c32c0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:19.377634 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4408f03f-18dc-41c1-9cba-ce52857c32c0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:19.378087 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4408f03f-18dc-41c1-9cba-ce52857c32c0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:19.513853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4408f03f-18dc-41c1-9cba-ce52857c32c0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:19.522589 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4408f03f-18dc-41c1-9cba-ce52857c32c0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:19.524112 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4408f03f-18dc-41c1-9cba-ce52857c32c0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:19.525432 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4408f03f-18dc-41c1-9cba-ce52857c32c0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1744 microversion: 2.20 time: 0.165102 Jul 12 03:53:19.526054 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 234/483] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:19 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:20.546717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8dfcde34-c727-4562-b267-397b74197294 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:20.547367 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8dfcde34-c727-4562-b267-397b74197294 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:20.555889 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8dfcde34-c727-4562-b267-397b74197294 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:20.556489 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8dfcde34-c727-4562-b267-397b74197294 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:20.557566 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8dfcde34-c727-4562-b267-397b74197294 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:20.558455 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8dfcde34-c727-4562-b267-397b74197294 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:20.699223 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8dfcde34-c727-4562-b267-397b74197294 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:20.707326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8dfcde34-c727-4562-b267-397b74197294 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:20.708843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8dfcde34-c727-4562-b267-397b74197294 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:20.709985 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8dfcde34-c727-4562-b267-397b74197294 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1744 microversion: 2.20 time: 0.168694 Jul 12 03:53:20.710535 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 250/484] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:20 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:21.728804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8d3775a1-45c4-44bb-8904-2f469a3ce241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:21.729372 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8d3775a1-45c4-44bb-8904-2f469a3ce241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:21.737760 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d3775a1-45c4-44bb-8904-2f469a3ce241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:21.738340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d3775a1-45c4-44bb-8904-2f469a3ce241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:21.739464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d3775a1-45c4-44bb-8904-2f469a3ce241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:21.740068 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d3775a1-45c4-44bb-8904-2f469a3ce241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:21.889333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8d3775a1-45c4-44bb-8904-2f469a3ce241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:21.898177 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8d3775a1-45c4-44bb-8904-2f469a3ce241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:21.899743 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8d3775a1-45c4-44bb-8904-2f469a3ce241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:21.900940 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8d3775a1-45c4-44bb-8904-2f469a3ce241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1744 microversion: 2.20 time: 0.176312 Jul 12 03:53:21.901492 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 235/485] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:21 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:22.922682 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6a34aef3-a467-4500-9f31-7cdd6305e470 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:22.923677 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-6a34aef3-a467-4500-9f31-7cdd6305e470 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:22.934576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6a34aef3-a467-4500-9f31-7cdd6305e470 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:22.935030 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6a34aef3-a467-4500-9f31-7cdd6305e470 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:22.935797 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6a34aef3-a467-4500-9f31-7cdd6305e470 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:22.936271 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6a34aef3-a467-4500-9f31-7cdd6305e470 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:22.943402 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:53:23.075124 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-6a34aef3-a467-4500-9f31-7cdd6305e470 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:23.088074 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-6a34aef3-a467-4500-9f31-7cdd6305e470 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:23.090217 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-6a34aef3-a467-4500-9f31-7cdd6305e470 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:23.091623 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-6a34aef3-a467-4500-9f31-7cdd6305e470 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1744 microversion: 2.20 time: 0.175467 Jul 12 03:53:23.092222 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 251/486] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:22 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:24.113487 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-41d19e91-5ca0-41e4-8589-238111e4c8a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:24.114340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-41d19e91-5ca0-41e4-8589-238111e4c8a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:24.124862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-41d19e91-5ca0-41e4-8589-238111e4c8a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:24.125538 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-41d19e91-5ca0-41e4-8589-238111e4c8a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:24.126687 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-41d19e91-5ca0-41e4-8589-238111e4c8a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:24.127339 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-41d19e91-5ca0-41e4-8589-238111e4c8a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:24.266262 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-41d19e91-5ca0-41e4-8589-238111e4c8a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:24.279602 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-41d19e91-5ca0-41e4-8589-238111e4c8a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:24.281911 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-41d19e91-5ca0-41e4-8589-238111e4c8a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:24.283697 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-41d19e91-5ca0-41e4-8589-238111e4c8a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1744 microversion: 2.20 time: 0.176147 Jul 12 03:53:24.284470 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 236/487] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:24 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:24.701646 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-a9c129c0-e386-40b8-944c-51ba039150e3 req-00ac0ced-a34c-45b3-a039-26a7832e36e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae771f5b-03de-46db-82fc-cd94d731405a", "name": "network-vif-plugged", "status": "completed", "tag": "28823cfb-b758-4345-b841-353bcf53f8b8"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:53:24.711571 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-a9c129c0-e386-40b8-944c-51ba039150e3 req-00ac0ced-a34c-45b3-a039-26a7832e36e3 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:24.712120 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-a9c129c0-e386-40b8-944c-51ba039150e3 req-00ac0ced-a34c-45b3-a039-26a7832e36e3 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:24.724322 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-a9c129c0-e386-40b8-944c-51ba039150e3 req-00ac0ced-a34c-45b3-a039-26a7832e36e3 service nova] Creating event network-vif-plugged:28823cfb-b758-4345-b841-353bcf53f8b8 for instance ae771f5b-03de-46db-82fc-cd94d731405a on hv-cinder-84773 Jul 12 03:53:24.729428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-a9c129c0-e386-40b8-944c-51ba039150e3 req-00ac0ced-a34c-45b3-a039-26a7832e36e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031632 Jul 12 03:53:24.730040 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 252/488] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:53:25.153847 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2008680369", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "networks": [{"uuid": "a69bab14-5f26-41ea-927b-f205133d3d80"}]}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:53:25.206293 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.network.neutron [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] validate_networks() for [('a69bab14-5f26-41ea-927b-f205133d3d80', None, None, None, None, None)] {{(pid=124435) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:53:25.306832 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e8c0b32b-0122-46b8-a73d-89c3cefa1e57 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:25.307563 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e8c0b32b-0122-46b8-a73d-89c3cefa1e57 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:25.314275 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e8c0b32b-0122-46b8-a73d-89c3cefa1e57 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:25.314735 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e8c0b32b-0122-46b8-a73d-89c3cefa1e57 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:25.315494 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e8c0b32b-0122-46b8-a73d-89c3cefa1e57 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:25.315930 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e8c0b32b-0122-46b8-a73d-89c3cefa1e57 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:25.445115 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e8c0b32b-0122-46b8-a73d-89c3cefa1e57 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:25.453595 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e8c0b32b-0122-46b8-a73d-89c3cefa1e57 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:25.455095 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e8c0b32b-0122-46b8-a73d-89c3cefa1e57 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:25.456620 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e8c0b32b-0122-46b8-a73d-89c3cefa1e57 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1744 microversion: 2.20 time: 0.153717 Jul 12 03:53:25.457155 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 253/489] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:25 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:25.554629 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Flavor limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:53:25.555043 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Image limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:53:25.555503 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Flavor pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:53:25.555901 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Image pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:53:25.556348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:53:25.566123 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:25.566494 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:25.567272 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:25.567698 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:25.584407 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Getting quotas for project cd2e5f7d1e2e4aa3a98bbbf89a6ec276. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:53:25.588617 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Getting quotas for user 9e27cbb381174481ade02b228faa8fb8 and project cd2e5f7d1e2e4aa3a98bbbf89a6ec276. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:53:25.600256 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Going to run 1 instances... {{(pid=124435) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:53:25.602471 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124435) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:53:25.650181 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5fa4df2d-6ae2-4e1d-a5ef-0021195a0e6e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500224 Jul 12 03:53:25.650985 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 237/490] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:53:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 03:53:25.661298 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-bc2f7a93-4b72-43d9-8b76-9da3d8e1b2eb tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:25.661936 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-bc2f7a93-4b72-43d9-8b76-9da3d8e1b2eb tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:25.720983 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-bc2f7a93-4b72-43d9-8b76-9da3d8e1b2eb tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:25.727772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-bc2f7a93-4b72-43d9-8b76-9da3d8e1b2eb tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1219 microversion: 2.1 time: 0.070397 Jul 12 03:53:25.728394 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 254/491] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:25 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:26.480116 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-384a7c24-ae22-42c5-8ecf-c0dbae33a919 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:26.481048 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-384a7c24-ae22-42c5-8ecf-c0dbae33a919 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:26.489689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-384a7c24-ae22-42c5-8ecf-c0dbae33a919 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:26.490147 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-384a7c24-ae22-42c5-8ecf-c0dbae33a919 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:26.490974 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-384a7c24-ae22-42c5-8ecf-c0dbae33a919 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:26.491403 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-384a7c24-ae22-42c5-8ecf-c0dbae33a919 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:26.634673 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-384a7c24-ae22-42c5-8ecf-c0dbae33a919 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:26.643307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-384a7c24-ae22-42c5-8ecf-c0dbae33a919 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:26.644853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-384a7c24-ae22-42c5-8ecf-c0dbae33a919 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:26.646008 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-384a7c24-ae22-42c5-8ecf-c0dbae33a919 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1744 microversion: 2.20 time: 0.173633 Jul 12 03:53:26.646626 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 238/492] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:26 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:26.746309 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-58d260dd-0547-495a-84dc-01ce602f0fa2 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:26.746900 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-58d260dd-0547-495a-84dc-01ce602f0fa2 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:26.755007 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-58d260dd-0547-495a-84dc-01ce602f0fa2 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:26.755568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-58d260dd-0547-495a-84dc-01ce602f0fa2 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:26.756407 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-58d260dd-0547-495a-84dc-01ce602f0fa2 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:26.756841 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-58d260dd-0547-495a-84dc-01ce602f0fa2 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:27.077078 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-58d260dd-0547-495a-84dc-01ce602f0fa2 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:27.085990 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-58d260dd-0547-495a-84dc-01ce602f0fa2 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1289 microversion: 2.1 time: 0.344817 Jul 12 03:53:27.086694 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 255/493] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:26 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1289 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:27.667290 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-08992bf2-c249-4f68-a280-578d6aeef288 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:27.668694 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-08992bf2-c249-4f68-a280-578d6aeef288 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:27.675738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-08992bf2-c249-4f68-a280-578d6aeef288 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:27.676297 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-08992bf2-c249-4f68-a280-578d6aeef288 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:27.677151 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-08992bf2-c249-4f68-a280-578d6aeef288 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:27.677640 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-08992bf2-c249-4f68-a280-578d6aeef288 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:27.897721 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-08992bf2-c249-4f68-a280-578d6aeef288 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:27.910976 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-08992bf2-c249-4f68-a280-578d6aeef288 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:27.913756 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-08992bf2-c249-4f68-a280-578d6aeef288 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:27.915252 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-08992bf2-c249-4f68-a280-578d6aeef288 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1739 microversion: 2.20 time: 0.253484 Jul 12 03:53:27.928842 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 239/494] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:27 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:28.103294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-33498d8e-8e65-4475-adc8-11c6882cc6e7 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:28.104585 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-33498d8e-8e65-4475-adc8-11c6882cc6e7 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:28.108527 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=43 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:53:28.112972 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-33498d8e-8e65-4475-adc8-11c6882cc6e7 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:28.113705 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-33498d8e-8e65-4475-adc8-11c6882cc6e7 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:28.114708 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-33498d8e-8e65-4475-adc8-11c6882cc6e7 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:28.115346 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-33498d8e-8e65-4475-adc8-11c6882cc6e7 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:28.259734 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-5868909a-d271-4bec-af3c-99a65e44c63a req-d36c6c63-1f8c-41b7-8224-2c697bc3911e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba4e504b-f1de-47ca-a7a9-e6e0876eb670", "tag": "027b88e5-15ff-4542-ae28-472d408f62f4"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:53:28.273651 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-5868909a-d271-4bec-af3c-99a65e44c63a req-d36c6c63-1f8c-41b7-8224-2c697bc3911e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:28.274100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-5868909a-d271-4bec-af3c-99a65e44c63a req-d36c6c63-1f8c-41b7-8224-2c697bc3911e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:28.278866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-33498d8e-8e65-4475-adc8-11c6882cc6e7 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:28.288885 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-33498d8e-8e65-4475-adc8-11c6882cc6e7 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1319 microversion: 2.1 time: 0.189728 Jul 12 03:53:28.289463 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 256/495] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:28 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:28.294917 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-5868909a-d271-4bec-af3c-99a65e44c63a req-d36c6c63-1f8c-41b7-8224-2c697bc3911e service nova] Creating event network-changed:027b88e5-15ff-4542-ae28-472d408f62f4 for instance ba4e504b-f1de-47ca-a7a9-e6e0876eb670 on hv-cinder-84773 Jul 12 03:53:28.300115 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-5868909a-d271-4bec-af3c-99a65e44c63a req-d36c6c63-1f8c-41b7-8224-2c697bc3911e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050547 Jul 12 03:53:28.301129 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 240/496] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 03:53:28.934871 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-46eff714-b414-4a3a-aa46-df271a0fdcfc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:28.935485 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-46eff714-b414-4a3a-aa46-df271a0fdcfc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:28.944870 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-46eff714-b414-4a3a-aa46-df271a0fdcfc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:28.945318 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-46eff714-b414-4a3a-aa46-df271a0fdcfc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:28.946102 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-46eff714-b414-4a3a-aa46-df271a0fdcfc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:28.946537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-46eff714-b414-4a3a-aa46-df271a0fdcfc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:29.088805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-46eff714-b414-4a3a-aa46-df271a0fdcfc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:29.097316 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-46eff714-b414-4a3a-aa46-df271a0fdcfc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:29.098867 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-46eff714-b414-4a3a-aa46-df271a0fdcfc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:29.100101 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-46eff714-b414-4a3a-aa46-df271a0fdcfc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1739 microversion: 2.20 time: 0.169250 Jul 12 03:53:29.101316 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 257/497] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:28 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:53:29.307815 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5d32e9a9-37c3-43a4-83ef-c8c86d432e11 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:29.308931 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5d32e9a9-37c3-43a4-83ef-c8c86d432e11 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:29.316779 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5d32e9a9-37c3-43a4-83ef-c8c86d432e11 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:29.317549 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5d32e9a9-37c3-43a4-83ef-c8c86d432e11 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:29.318641 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5d32e9a9-37c3-43a4-83ef-c8c86d432e11 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:29.319048 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5d32e9a9-37c3-43a4-83ef-c8c86d432e11 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:29.337969 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:53:29.464194 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5d32e9a9-37c3-43a4-83ef-c8c86d432e11 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:29.472684 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5d32e9a9-37c3-43a4-83ef-c8c86d432e11 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1319 microversion: 2.1 time: 0.169843 Jul 12 03:53:29.473366 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 241/498] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:29 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:30.118885 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-dd3c9066-5e3d-4489-8fe0-0d437b4e3a85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:30.119457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-dd3c9066-5e3d-4489-8fe0-0d437b4e3a85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:30.126924 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dd3c9066-5e3d-4489-8fe0-0d437b4e3a85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:30.127240 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dd3c9066-5e3d-4489-8fe0-0d437b4e3a85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:30.128045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dd3c9066-5e3d-4489-8fe0-0d437b4e3a85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:30.128755 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dd3c9066-5e3d-4489-8fe0-0d437b4e3a85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:30.261734 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-dd3c9066-5e3d-4489-8fe0-0d437b4e3a85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:30.271986 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-dd3c9066-5e3d-4489-8fe0-0d437b4e3a85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:30.273550 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-dd3c9066-5e3d-4489-8fe0-0d437b4e3a85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:30.274702 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-dd3c9066-5e3d-4489-8fe0-0d437b4e3a85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1739 microversion: 2.20 time: 0.159821 Jul 12 03:53:30.275417 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 258/499] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:30 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:30.489120 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-867bb660-180c-446c-93ed-3db913836670 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:30.490485 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-867bb660-180c-446c-93ed-3db913836670 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:30.497512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-867bb660-180c-446c-93ed-3db913836670 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:30.498355 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-867bb660-180c-446c-93ed-3db913836670 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:30.499451 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-867bb660-180c-446c-93ed-3db913836670 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:30.499886 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-867bb660-180c-446c-93ed-3db913836670 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:30.635220 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-867bb660-180c-446c-93ed-3db913836670 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:30.643626 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-867bb660-180c-446c-93ed-3db913836670 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1319 microversion: 2.1 time: 0.158434 Jul 12 03:53:30.644262 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 242/500] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:30 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:31.294709 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d7541787-0181-4fd5-a62a-a056fb8c9b25 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:31.295926 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d7541787-0181-4fd5-a62a-a056fb8c9b25 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:31.309099 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d7541787-0181-4fd5-a62a-a056fb8c9b25 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:31.310321 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d7541787-0181-4fd5-a62a-a056fb8c9b25 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:31.315721 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d7541787-0181-4fd5-a62a-a056fb8c9b25 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:31.316358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d7541787-0181-4fd5-a62a-a056fb8c9b25 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:31.485205 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d7541787-0181-4fd5-a62a-a056fb8c9b25 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:31.498671 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d7541787-0181-4fd5-a62a-a056fb8c9b25 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:31.500386 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d7541787-0181-4fd5-a62a-a056fb8c9b25 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:31.504239 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d7541787-0181-4fd5-a62a-a056fb8c9b25 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1739 microversion: 2.20 time: 0.214384 Jul 12 03:53:31.505586 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 259/501] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:31 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:31.663696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6df7c665-e4f4-4be9-94da-70145942e555 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:31.664370 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6df7c665-e4f4-4be9-94da-70145942e555 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:31.671437 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6df7c665-e4f4-4be9-94da-70145942e555 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:31.671893 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6df7c665-e4f4-4be9-94da-70145942e555 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:31.672689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6df7c665-e4f4-4be9-94da-70145942e555 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:31.673298 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6df7c665-e4f4-4be9-94da-70145942e555 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:31.821139 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6df7c665-e4f4-4be9-94da-70145942e555 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:31.831514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6df7c665-e4f4-4be9-94da-70145942e555 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1319 microversion: 2.1 time: 0.173756 Jul 12 03:53:31.832506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 243/502] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:31 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:32.531836 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-21f15840-a466-44e1-b588-4b0705a77a27 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:32.533627 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-21f15840-a466-44e1-b588-4b0705a77a27 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:32.540372 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-21f15840-a466-44e1-b588-4b0705a77a27 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:32.541129 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-21f15840-a466-44e1-b588-4b0705a77a27 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:32.542212 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-21f15840-a466-44e1-b588-4b0705a77a27 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:32.542709 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-21f15840-a466-44e1-b588-4b0705a77a27 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:32.699480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-21f15840-a466-44e1-b588-4b0705a77a27 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:32.711240 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-21f15840-a466-44e1-b588-4b0705a77a27 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:32.712977 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-21f15840-a466-44e1-b588-4b0705a77a27 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:32.714215 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-21f15840-a466-44e1-b588-4b0705a77a27 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1739 microversion: 2.20 time: 0.191336 Jul 12 03:53:32.724036 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 260/503] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:32 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:32.850806 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-97b21323-5825-48a7-b1a4-dc5b8f628398 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:32.851931 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-97b21323-5825-48a7-b1a4-dc5b8f628398 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:32.856299 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:53:32.861220 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-97b21323-5825-48a7-b1a4-dc5b8f628398 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:32.862190 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-97b21323-5825-48a7-b1a4-dc5b8f628398 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:32.863945 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-97b21323-5825-48a7-b1a4-dc5b8f628398 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:32.864740 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-97b21323-5825-48a7-b1a4-dc5b8f628398 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:33.029425 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-97b21323-5825-48a7-b1a4-dc5b8f628398 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:33.037833 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-97b21323-5825-48a7-b1a4-dc5b8f628398 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1319 microversion: 2.1 time: 0.192269 Jul 12 03:53:33.038411 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 244/504] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:32 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:33.733681 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-761b5ac0-564b-4b31-b658-b64a78e56f55 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:33.734303 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-761b5ac0-564b-4b31-b658-b64a78e56f55 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:33.741517 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-761b5ac0-564b-4b31-b658-b64a78e56f55 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:33.741972 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-761b5ac0-564b-4b31-b658-b64a78e56f55 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:33.742798 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-761b5ac0-564b-4b31-b658-b64a78e56f55 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:33.743203 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-761b5ac0-564b-4b31-b658-b64a78e56f55 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:33.899667 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-761b5ac0-564b-4b31-b658-b64a78e56f55 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:33.908278 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-761b5ac0-564b-4b31-b658-b64a78e56f55 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:33.909789 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-761b5ac0-564b-4b31-b658-b64a78e56f55 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:33.910949 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-761b5ac0-564b-4b31-b658-b64a78e56f55 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1739 microversion: 2.20 time: 0.181486 Jul 12 03:53:33.911775 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 261/505] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:33 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:34.054793 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-90a46f4d-3704-4d16-a4ae-256d3e01e98a tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:34.056223 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-90a46f4d-3704-4d16-a4ae-256d3e01e98a tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:34.063312 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-90a46f4d-3704-4d16-a4ae-256d3e01e98a tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:34.063748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-90a46f4d-3704-4d16-a4ae-256d3e01e98a tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:34.064673 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-90a46f4d-3704-4d16-a4ae-256d3e01e98a tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:34.065306 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-90a46f4d-3704-4d16-a4ae-256d3e01e98a tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:34.218548 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-90a46f4d-3704-4d16-a4ae-256d3e01e98a tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:34.226241 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-90a46f4d-3704-4d16-a4ae-256d3e01e98a tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1319 microversion: 2.1 time: 0.175423 Jul 12 03:53:34.237754 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 245/506] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:34 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:34.933375 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a96e242b-429f-4391-b836-851b3dc5fab4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:34.934016 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a96e242b-429f-4391-b836-851b3dc5fab4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:34.949240 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a96e242b-429f-4391-b836-851b3dc5fab4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:34.950054 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a96e242b-429f-4391-b836-851b3dc5fab4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:34.950958 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a96e242b-429f-4391-b836-851b3dc5fab4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:34.951679 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a96e242b-429f-4391-b836-851b3dc5fab4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:35.101977 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a96e242b-429f-4391-b836-851b3dc5fab4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:35.110367 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a96e242b-429f-4391-b836-851b3dc5fab4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:35.112111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a96e242b-429f-4391-b836-851b3dc5fab4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:35.113506 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a96e242b-429f-4391-b836-851b3dc5fab4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1739 microversion: 2.20 time: 0.184254 Jul 12 03:53:35.114279 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 262/507] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:34 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:35.246779 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-edaca19c-fae9-4937-9031-fe59924c7e94 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:35.248412 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-edaca19c-fae9-4937-9031-fe59924c7e94 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:35.255353 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-edaca19c-fae9-4937-9031-fe59924c7e94 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:35.256065 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-edaca19c-fae9-4937-9031-fe59924c7e94 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:35.257091 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-edaca19c-fae9-4937-9031-fe59924c7e94 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:35.257855 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-edaca19c-fae9-4937-9031-fe59924c7e94 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:35.394900 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-edaca19c-fae9-4937-9031-fe59924c7e94 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:35.404858 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-edaca19c-fae9-4937-9031-fe59924c7e94 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1319 microversion: 2.1 time: 0.161751 Jul 12 03:53:35.405988 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 246/508] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:35 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:36.134276 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-17cb3b4d-06f5-4165-9164-f6c5960ebefc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:36.134885 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-17cb3b4d-06f5-4165-9164-f6c5960ebefc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:36.137082 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:53:36.144833 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-17cb3b4d-06f5-4165-9164-f6c5960ebefc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:36.145286 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-17cb3b4d-06f5-4165-9164-f6c5960ebefc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:36.146225 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-17cb3b4d-06f5-4165-9164-f6c5960ebefc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:36.146670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-17cb3b4d-06f5-4165-9164-f6c5960ebefc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:36.299673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-17cb3b4d-06f5-4165-9164-f6c5960ebefc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:36.308748 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-17cb3b4d-06f5-4165-9164-f6c5960ebefc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:36.310284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-17cb3b4d-06f5-4165-9164-f6c5960ebefc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:36.311512 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-17cb3b4d-06f5-4165-9164-f6c5960ebefc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1739 microversion: 2.20 time: 0.181375 Jul 12 03:53:36.312164 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 263/509] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:36 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:36.424550 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:53:36.426282 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=6 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:53:36.430851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0cfd10a1-9054-4b26-bbbd-f732ac2f7d9e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:36.431479 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0cfd10a1-9054-4b26-bbbd-f732ac2f7d9e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:36.438354 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0cfd10a1-9054-4b26-bbbd-f732ac2f7d9e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:36.438797 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0cfd10a1-9054-4b26-bbbd-f732ac2f7d9e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:36.439713 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0cfd10a1-9054-4b26-bbbd-f732ac2f7d9e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:36.440171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0cfd10a1-9054-4b26-bbbd-f732ac2f7d9e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:36.587635 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0cfd10a1-9054-4b26-bbbd-f732ac2f7d9e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:36.597715 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0cfd10a1-9054-4b26-bbbd-f732ac2f7d9e tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1319 microversion: 2.1 time: 0.174578 Jul 12 03:53:36.598416 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 247/510] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:36 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:37.096406 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-c2892a5b-b221-4f0a-9b3c-69e0ef199392 req-dcdc5bf3-5e3a-4eeb-a754-a85721f4fccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba4e504b-f1de-47ca-a7a9-e6e0876eb670", "name": "network-vif-plugged", "status": "completed", "tag": "027b88e5-15ff-4542-ae28-472d408f62f4"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:53:37.106349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-c2892a5b-b221-4f0a-9b3c-69e0ef199392 req-dcdc5bf3-5e3a-4eeb-a754-a85721f4fccc service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:37.107059 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-c2892a5b-b221-4f0a-9b3c-69e0ef199392 req-dcdc5bf3-5e3a-4eeb-a754-a85721f4fccc service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:37.120812 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-c2892a5b-b221-4f0a-9b3c-69e0ef199392 req-dcdc5bf3-5e3a-4eeb-a754-a85721f4fccc service nova] Creating event network-vif-plugged:027b88e5-15ff-4542-ae28-472d408f62f4 for instance ba4e504b-f1de-47ca-a7a9-e6e0876eb670 on hv-cinder-84773 Jul 12 03:53:37.125862 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-c2892a5b-b221-4f0a-9b3c-69e0ef199392 req-dcdc5bf3-5e3a-4eeb-a754-a85721f4fccc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033201 Jul 12 03:53:37.126501 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 264/511] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:53:37.331761 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a75d5d0d-12ac-4ff4-8bd4-20e567094321 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:37.332398 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a75d5d0d-12ac-4ff4-8bd4-20e567094321 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:37.339217 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a75d5d0d-12ac-4ff4-8bd4-20e567094321 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:37.339680 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a75d5d0d-12ac-4ff4-8bd4-20e567094321 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:37.340523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a75d5d0d-12ac-4ff4-8bd4-20e567094321 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:37.340952 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a75d5d0d-12ac-4ff4-8bd4-20e567094321 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:37.518430 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a75d5d0d-12ac-4ff4-8bd4-20e567094321 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:37.526889 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a75d5d0d-12ac-4ff4-8bd4-20e567094321 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:37.528437 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a75d5d0d-12ac-4ff4-8bd4-20e567094321 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:37.529649 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a75d5d0d-12ac-4ff4-8bd4-20e567094321 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1739 microversion: 2.20 time: 0.203107 Jul 12 03:53:37.530189 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 248/512] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:37 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:37.620313 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-280fffe4-5f87-48b2-bd8d-b9059dae2c28 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:37.621449 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-280fffe4-5f87-48b2-bd8d-b9059dae2c28 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:37.631984 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-280fffe4-5f87-48b2-bd8d-b9059dae2c28 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:37.632772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-280fffe4-5f87-48b2-bd8d-b9059dae2c28 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:37.634011 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-280fffe4-5f87-48b2-bd8d-b9059dae2c28 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:37.634722 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-280fffe4-5f87-48b2-bd8d-b9059dae2c28 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:37.771365 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-280fffe4-5f87-48b2-bd8d-b9059dae2c28 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:37.779171 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-280fffe4-5f87-48b2-bd8d-b9059dae2c28 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1319 microversion: 2.1 time: 0.166579 Jul 12 03:53:37.779736 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 265/513] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:37 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:38.551234 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-36aeb57d-b1f7-4f6d-9275-db582155b500 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:38.552313 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-36aeb57d-b1f7-4f6d-9275-db582155b500 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:38.563189 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-36aeb57d-b1f7-4f6d-9275-db582155b500 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:38.563969 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-36aeb57d-b1f7-4f6d-9275-db582155b500 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:38.564845 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-36aeb57d-b1f7-4f6d-9275-db582155b500 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:38.565271 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-36aeb57d-b1f7-4f6d-9275-db582155b500 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:38.710248 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-36aeb57d-b1f7-4f6d-9275-db582155b500 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:38.718932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-36aeb57d-b1f7-4f6d-9275-db582155b500 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:38.720553 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-36aeb57d-b1f7-4f6d-9275-db582155b500 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:38.721703 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-36aeb57d-b1f7-4f6d-9275-db582155b500 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1721 microversion: 2.20 time: 0.177173 Jul 12 03:53:38.722422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 249/514] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:38 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:38.798734 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-13ae1a3a-94b9-4b9b-a544-e960acecc4f6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:38.799505 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-13ae1a3a-94b9-4b9b-a544-e960acecc4f6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:38.808524 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-13ae1a3a-94b9-4b9b-a544-e960acecc4f6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:38.809114 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-13ae1a3a-94b9-4b9b-a544-e960acecc4f6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:38.810084 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-13ae1a3a-94b9-4b9b-a544-e960acecc4f6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:38.810677 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-13ae1a3a-94b9-4b9b-a544-e960acecc4f6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:38.940255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-13ae1a3a-94b9-4b9b-a544-e960acecc4f6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:38.947984 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-13ae1a3a-94b9-4b9b-a544-e960acecc4f6 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1319 microversion: 2.1 time: 0.154415 Jul 12 03:53:38.948585 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 266/515] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:38 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:39.744471 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0a5a842e-cb94-45f2-b99d-fe3ebb3afc33 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:39.745417 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0a5a842e-cb94-45f2-b99d-fe3ebb3afc33 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:39.756993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0a5a842e-cb94-45f2-b99d-fe3ebb3afc33 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:39.757836 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0a5a842e-cb94-45f2-b99d-fe3ebb3afc33 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:39.759535 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0a5a842e-cb94-45f2-b99d-fe3ebb3afc33 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:39.760291 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0a5a842e-cb94-45f2-b99d-fe3ebb3afc33 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:39.912486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0a5a842e-cb94-45f2-b99d-fe3ebb3afc33 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:39.924155 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0a5a842e-cb94-45f2-b99d-fe3ebb3afc33 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:39.925828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0a5a842e-cb94-45f2-b99d-fe3ebb3afc33 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:39.927006 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0a5a842e-cb94-45f2-b99d-fe3ebb3afc33 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1721 microversion: 2.20 time: 0.189315 Jul 12 03:53:39.927600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 250/516] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:39 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:39.965319 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c0d7da6d-e18d-41fc-a846-d8000da3da1b tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:39.965932 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c0d7da6d-e18d-41fc-a846-d8000da3da1b tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:39.972825 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c0d7da6d-e18d-41fc-a846-d8000da3da1b tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:39.973272 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c0d7da6d-e18d-41fc-a846-d8000da3da1b tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:39.974028 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c0d7da6d-e18d-41fc-a846-d8000da3da1b tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:39.974456 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c0d7da6d-e18d-41fc-a846-d8000da3da1b tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:40.110052 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c0d7da6d-e18d-41fc-a846-d8000da3da1b tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:40.118972 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c0d7da6d-e18d-41fc-a846-d8000da3da1b tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1319 microversion: 2.1 time: 0.157546 Jul 12 03:53:40.119564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 267/517] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:39 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:40.945880 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-75bfc000-9ccd-44b8-9906-bb453fb0d209 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:40.946455 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-75bfc000-9ccd-44b8-9906-bb453fb0d209 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:40.953397 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-75bfc000-9ccd-44b8-9906-bb453fb0d209 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:40.953837 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-75bfc000-9ccd-44b8-9906-bb453fb0d209 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:40.954618 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-75bfc000-9ccd-44b8-9906-bb453fb0d209 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:40.955055 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-75bfc000-9ccd-44b8-9906-bb453fb0d209 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:41.044190 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-a8131bde-e4a7-4677-a343-bd3e53ee5ff1 req-09a13650-e955-4704-bcae-0fbd98ebab28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae771f5b-03de-46db-82fc-cd94d731405a", "name": "network-vif-unplugged", "status": "completed", "tag": "28823cfb-b758-4345-b841-353bcf53f8b8"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:53:41.055733 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-a8131bde-e4a7-4677-a343-bd3e53ee5ff1 req-09a13650-e955-4704-bcae-0fbd98ebab28 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:41.056569 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-a8131bde-e4a7-4677-a343-bd3e53ee5ff1 req-09a13650-e955-4704-bcae-0fbd98ebab28 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:41.069175 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-a8131bde-e4a7-4677-a343-bd3e53ee5ff1 req-09a13650-e955-4704-bcae-0fbd98ebab28 service nova] Creating event network-vif-unplugged:28823cfb-b758-4345-b841-353bcf53f8b8 for instance ae771f5b-03de-46db-82fc-cd94d731405a on hv-cinder-84773 Jul 12 03:53:41.074898 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-a8131bde-e4a7-4677-a343-bd3e53ee5ff1 req-09a13650-e955-4704-bcae-0fbd98ebab28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034333 Jul 12 03:53:41.076153 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 268/518] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:53:41.095962 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-75bfc000-9ccd-44b8-9906-bb453fb0d209 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:41.104503 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-75bfc000-9ccd-44b8-9906-bb453fb0d209 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:41.106012 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-75bfc000-9ccd-44b8-9906-bb453fb0d209 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:41.107182 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-75bfc000-9ccd-44b8-9906-bb453fb0d209 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1721 microversion: 2.20 time: 0.165357 Jul 12 03:53:41.107722 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 251/519] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:40 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:41.135895 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-79f71dba-09ce-488d-b797-53c03689d73d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:41.136641 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-79f71dba-09ce-488d-b797-53c03689d73d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:41.143424 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-79f71dba-09ce-488d-b797-53c03689d73d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:41.143875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-79f71dba-09ce-488d-b797-53c03689d73d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:41.144672 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-79f71dba-09ce-488d-b797-53c03689d73d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:41.145106 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-79f71dba-09ce-488d-b797-53c03689d73d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:41.281683 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-79f71dba-09ce-488d-b797-53c03689d73d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:41.289559 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-79f71dba-09ce-488d-b797-53c03689d73d tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1508 microversion: 2.1 time: 0.157905 Jul 12 03:53:41.290127 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 269/520] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:53:41 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:53:41.306470 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ce2900cc-f5dd-418a-9a1f-eda75de31cd1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1831e325-efc3-4a6f-9d71-e99ecfe06e42", "device": "/dev/sdb"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:53:41.307591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ce2900cc-f5dd-418a-9a1f-eda75de31cd1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:41.313834 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ce2900cc-f5dd-418a-9a1f-eda75de31cd1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:41.314687 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ce2900cc-f5dd-418a-9a1f-eda75de31cd1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:41.315448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ce2900cc-f5dd-418a-9a1f-eda75de31cd1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:41.315882 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ce2900cc-f5dd-418a-9a1f-eda75de31cd1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:42.126400 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d1733ced-4b84-4bac-99e4-f80d7779cf84 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:42.126955 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d1733ced-4b84-4bac-99e4-f80d7779cf84 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:42.133811 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1733ced-4b84-4bac-99e4-f80d7779cf84 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:42.134236 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1733ced-4b84-4bac-99e4-f80d7779cf84 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:42.134999 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1733ced-4b84-4bac-99e4-f80d7779cf84 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:42.135430 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1733ced-4b84-4bac-99e4-f80d7779cf84 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:42.277027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d1733ced-4b84-4bac-99e4-f80d7779cf84 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:42.280620 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:53:42.286326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d1733ced-4b84-4bac-99e4-f80d7779cf84 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:42.287824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d1733ced-4b84-4bac-99e4-f80d7779cf84 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:42.289041 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d1733ced-4b84-4bac-99e4-f80d7779cf84 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1721 microversion: 2.20 time: 0.166673 Jul 12 03:53:42.289784 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 270/521] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:42 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:42.328479 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ce2900cc-f5dd-418a-9a1f-eda75de31cd1 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "POST /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.025714 Jul 12 03:53:42.329080 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 252/522] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 03:53:41 2022] POST /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670/os-volume_attachments => generated 194 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:53:43.312814 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-430332dc-f4a6-4ca4-a85d-ed279433a886 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:43.313837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-430332dc-f4a6-4ca4-a85d-ed279433a886 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:43.320873 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-430332dc-f4a6-4ca4-a85d-ed279433a886 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:43.321357 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-430332dc-f4a6-4ca4-a85d-ed279433a886 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:43.322157 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-430332dc-f4a6-4ca4-a85d-ed279433a886 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:43.322615 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-430332dc-f4a6-4ca4-a85d-ed279433a886 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:43.469738 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-430332dc-f4a6-4ca4-a85d-ed279433a886 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:43.478768 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-430332dc-f4a6-4ca4-a85d-ed279433a886 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:43.480307 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-430332dc-f4a6-4ca4-a85d-ed279433a886 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:43.481474 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-430332dc-f4a6-4ca4-a85d-ed279433a886 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1664 microversion: 2.20 time: 0.176070 Jul 12 03:53:43.482031 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 271/523] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:43 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1664 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:43.500955 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9af59db5-96b6-4b85-8c6a-400d0ee3cf34 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8869bebe-69dd-49a6-a8ab-d3cfb5417803"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:53:43.502236 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9af59db5-96b6-4b85-8c6a-400d0ee3cf34 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:43.508861 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9af59db5-96b6-4b85-8c6a-400d0ee3cf34 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:43.509301 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9af59db5-96b6-4b85-8c6a-400d0ee3cf34 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:43.510063 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9af59db5-96b6-4b85-8c6a-400d0ee3cf34 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:43.510494 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9af59db5-96b6-4b85-8c6a-400d0ee3cf34 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:43.852405 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9af59db5-96b6-4b85-8c6a-400d0ee3cf34 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "POST /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.356622 Jul 12 03:53:43.853179 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 253/524] 10.222.0.20 () {62 vars in 1363 bytes} [Tue Jul 12 03:53:43 2022] POST /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-volume_attachments => generated 188 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:53:43.977497 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1fe9d545-d581-4704-9475-bf2f4089b854 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:53:43.978065 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1fe9d545-d581-4704-9475-bf2f4089b854 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:43.984708 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1fe9d545-d581-4704-9475-bf2f4089b854 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:43.985151 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1fe9d545-d581-4704-9475-bf2f4089b854 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:43.985936 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1fe9d545-d581-4704-9475-bf2f4089b854 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:43.986369 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1fe9d545-d581-4704-9475-bf2f4089b854 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:44.098724 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1fe9d545-d581-4704-9475-bf2f4089b854 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "POST /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/action" status: 202 len: 0 microversion: 2.20 time: 0.125022 Jul 12 03:53:44.099479 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 272/525] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jul 12 03:53:43 2022] POST /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:53:44.108600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-503eab9e-dd6d-43de-809a-e0b0a28f09a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:44.109233 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-503eab9e-dd6d-43de-809a-e0b0a28f09a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:44.116934 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-503eab9e-dd6d-43de-809a-e0b0a28f09a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:44.117387 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-503eab9e-dd6d-43de-809a-e0b0a28f09a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:44.118165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-503eab9e-dd6d-43de-809a-e0b0a28f09a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:44.118601 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-503eab9e-dd6d-43de-809a-e0b0a28f09a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:44.122937 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:53:44.270908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-503eab9e-dd6d-43de-809a-e0b0a28f09a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:44.280854 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-503eab9e-dd6d-43de-809a-e0b0a28f09a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:44.282460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-503eab9e-dd6d-43de-809a-e0b0a28f09a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:44.283934 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-503eab9e-dd6d-43de-809a-e0b0a28f09a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1750 microversion: 2.20 time: 0.179479 Jul 12 03:53:44.284608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 254/526] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:44 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:45.303798 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d98401bd-105e-47e3-90e2-fe86beacb554 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:45.304564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d98401bd-105e-47e3-90e2-fe86beacb554 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:45.311423 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d98401bd-105e-47e3-90e2-fe86beacb554 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:45.311947 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d98401bd-105e-47e3-90e2-fe86beacb554 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:45.312876 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d98401bd-105e-47e3-90e2-fe86beacb554 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:45.313381 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d98401bd-105e-47e3-90e2-fe86beacb554 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:45.448038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d98401bd-105e-47e3-90e2-fe86beacb554 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:45.457078 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d98401bd-105e-47e3-90e2-fe86beacb554 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:45.458602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d98401bd-105e-47e3-90e2-fe86beacb554 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:45.459796 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d98401bd-105e-47e3-90e2-fe86beacb554 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1752 microversion: 2.20 time: 0.161190 Jul 12 03:53:45.460597 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 273/527] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:45 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:46.482829 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3b056cfc-f143-4a69-9937-0015ecf4f54d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:46.483862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3b056cfc-f143-4a69-9937-0015ecf4f54d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:46.491759 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3b056cfc-f143-4a69-9937-0015ecf4f54d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:46.492236 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3b056cfc-f143-4a69-9937-0015ecf4f54d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:46.492988 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3b056cfc-f143-4a69-9937-0015ecf4f54d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:46.493420 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3b056cfc-f143-4a69-9937-0015ecf4f54d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:46.627134 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3b056cfc-f143-4a69-9937-0015ecf4f54d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:46.635600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3b056cfc-f143-4a69-9937-0015ecf4f54d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:46.637115 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3b056cfc-f143-4a69-9937-0015ecf4f54d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:46.638258 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3b056cfc-f143-4a69-9937-0015ecf4f54d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1752 microversion: 2.20 time: 0.162063 Jul 12 03:53:46.638804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 255/528] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:46 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:47.657911 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b2d5029d-847c-4671-a2e5-8dfe29b5eebe tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:47.659246 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b2d5029d-847c-4671-a2e5-8dfe29b5eebe tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:47.668410 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b2d5029d-847c-4671-a2e5-8dfe29b5eebe tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:47.668890 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b2d5029d-847c-4671-a2e5-8dfe29b5eebe tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:47.669644 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b2d5029d-847c-4671-a2e5-8dfe29b5eebe tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:47.670064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b2d5029d-847c-4671-a2e5-8dfe29b5eebe tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:47.816943 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b2d5029d-847c-4671-a2e5-8dfe29b5eebe tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:47.830311 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b2d5029d-847c-4671-a2e5-8dfe29b5eebe tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:47.831821 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b2d5029d-847c-4671-a2e5-8dfe29b5eebe tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:47.833002 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b2d5029d-847c-4671-a2e5-8dfe29b5eebe tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1752 microversion: 2.20 time: 0.179738 Jul 12 03:53:47.833607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 274/529] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:47 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:48.858525 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-30ad9ada-901a-48a9-bd88-b7e032f9a5e1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:48.859534 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-30ad9ada-901a-48a9-bd88-b7e032f9a5e1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:48.867219 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30ad9ada-901a-48a9-bd88-b7e032f9a5e1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:48.867670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30ad9ada-901a-48a9-bd88-b7e032f9a5e1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:48.868495 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30ad9ada-901a-48a9-bd88-b7e032f9a5e1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:48.868927 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30ad9ada-901a-48a9-bd88-b7e032f9a5e1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:49.002492 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-30ad9ada-901a-48a9-bd88-b7e032f9a5e1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:49.011305 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-30ad9ada-901a-48a9-bd88-b7e032f9a5e1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:49.012871 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-30ad9ada-901a-48a9-bd88-b7e032f9a5e1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:49.014034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-30ad9ada-901a-48a9-bd88-b7e032f9a5e1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1752 microversion: 2.20 time: 0.163361 Jul 12 03:53:49.014643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 256/530] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:48 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:50.033309 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ca6967b4-15eb-4d9c-aafe-9560066ab1a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:50.033878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ca6967b4-15eb-4d9c-aafe-9560066ab1a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:50.040321 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ca6967b4-15eb-4d9c-aafe-9560066ab1a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:50.040770 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ca6967b4-15eb-4d9c-aafe-9560066ab1a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:50.041582 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ca6967b4-15eb-4d9c-aafe-9560066ab1a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:50.042013 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ca6967b4-15eb-4d9c-aafe-9560066ab1a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:50.172174 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ca6967b4-15eb-4d9c-aafe-9560066ab1a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:50.180851 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ca6967b4-15eb-4d9c-aafe-9560066ab1a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:50.182356 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ca6967b4-15eb-4d9c-aafe-9560066ab1a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:50.183505 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ca6967b4-15eb-4d9c-aafe-9560066ab1a0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1752 microversion: 2.20 time: 0.154483 Jul 12 03:53:50.184050 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 275/531] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:50 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:51.166387 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-92d266b8-db11-40fa-a217-ce0a119eabce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:51.167286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-92d266b8-db11-40fa-a217-ce0a119eabce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:51.176703 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-92d266b8-db11-40fa-a217-ce0a119eabce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:51.177156 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-92d266b8-db11-40fa-a217-ce0a119eabce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:51.177922 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-92d266b8-db11-40fa-a217-ce0a119eabce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:51.178361 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-92d266b8-db11-40fa-a217-ce0a119eabce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:51.201660 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-92d266b8-db11-40fa-a217-ce0a119eabce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/ips" status: 200 len: 146 microversion: 2.1 time: 0.041800 Jul 12 03:53:51.202045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c58716ff-0afc-4333-8f43-3b40aada30a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:51.202558 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 257/532] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 03:53:51 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:53:51.202642 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c58716ff-0afc-4333-8f43-3b40aada30a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:51.209777 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c58716ff-0afc-4333-8f43-3b40aada30a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:51.210165 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c58716ff-0afc-4333-8f43-3b40aada30a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:51.210918 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c58716ff-0afc-4333-8f43-3b40aada30a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:51.211345 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c58716ff-0afc-4333-8f43-3b40aada30a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:51.347707 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c58716ff-0afc-4333-8f43-3b40aada30a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:51.356801 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c58716ff-0afc-4333-8f43-3b40aada30a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:51.358351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c58716ff-0afc-4333-8f43-3b40aada30a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:51.359503 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c58716ff-0afc-4333-8f43-3b40aada30a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1752 microversion: 2.20 time: 0.161530 Jul 12 03:53:51.360123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 276/533] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:51 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:52.381950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-25becd99-6e72-477a-b967-616986ea60af tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:52.383007 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-25becd99-6e72-477a-b967-616986ea60af tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:52.394441 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25becd99-6e72-477a-b967-616986ea60af tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:52.394897 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25becd99-6e72-477a-b967-616986ea60af tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:52.395660 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25becd99-6e72-477a-b967-616986ea60af tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:52.396134 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25becd99-6e72-477a-b967-616986ea60af tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:52.525169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-25becd99-6e72-477a-b967-616986ea60af tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:52.538043 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-25becd99-6e72-477a-b967-616986ea60af tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:52.540325 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-25becd99-6e72-477a-b967-616986ea60af tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:52.542000 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-25becd99-6e72-477a-b967-616986ea60af tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1752 microversion: 2.20 time: 0.166479 Jul 12 03:53:52.542768 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 258/534] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:52 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:53.567537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-bee4213b-6280-47c3-a21f-568075513b9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:53.568628 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-bee4213b-6280-47c3-a21f-568075513b9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:53.579771 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bee4213b-6280-47c3-a21f-568075513b9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:53.580571 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bee4213b-6280-47c3-a21f-568075513b9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:53.581826 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bee4213b-6280-47c3-a21f-568075513b9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:53.582544 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bee4213b-6280-47c3-a21f-568075513b9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:53.735623 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-bee4213b-6280-47c3-a21f-568075513b9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:53.749208 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-bee4213b-6280-47c3-a21f-568075513b9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:53.751523 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-bee4213b-6280-47c3-a21f-568075513b9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:53.753678 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-bee4213b-6280-47c3-a21f-568075513b9c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1752 microversion: 2.20 time: 0.192211 Jul 12 03:53:53.754327 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 277/535] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:53 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:54.776254 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5741806c-b8a3-44e2-b568-b536c7df4edb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:54.776865 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5741806c-b8a3-44e2-b568-b536c7df4edb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:54.786954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5741806c-b8a3-44e2-b568-b536c7df4edb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:54.787509 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5741806c-b8a3-44e2-b568-b536c7df4edb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:54.788705 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5741806c-b8a3-44e2-b568-b536c7df4edb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:54.789288 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5741806c-b8a3-44e2-b568-b536c7df4edb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:54.934454 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5741806c-b8a3-44e2-b568-b536c7df4edb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:54.945914 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5741806c-b8a3-44e2-b568-b536c7df4edb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:54.947546 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5741806c-b8a3-44e2-b568-b536c7df4edb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:54.948783 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5741806c-b8a3-44e2-b568-b536c7df4edb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1752 microversion: 2.20 time: 0.178748 Jul 12 03:53:54.949343 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 259/536] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:54 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:55.970993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1851df06-c838-4387-8141-0a0dcf981390 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:55.972090 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1851df06-c838-4387-8141-0a0dcf981390 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:55.979533 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1851df06-c838-4387-8141-0a0dcf981390 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:55.979987 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1851df06-c838-4387-8141-0a0dcf981390 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:55.980782 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1851df06-c838-4387-8141-0a0dcf981390 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:55.981218 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1851df06-c838-4387-8141-0a0dcf981390 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:56.128213 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1851df06-c838-4387-8141-0a0dcf981390 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:56.137221 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1851df06-c838-4387-8141-0a0dcf981390 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:56.138726 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1851df06-c838-4387-8141-0a0dcf981390 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:56.139881 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1851df06-c838-4387-8141-0a0dcf981390 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.175643 Jul 12 03:53:56.140487 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 278/537] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:55 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:56.733814 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1c89b7f7-6622-4018-8c07-77406d18837a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5f574d6-d076-4aa5-a313-0af2bf5af642"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:53:56.735056 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1c89b7f7-6622-4018-8c07-77406d18837a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:56.741715 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c89b7f7-6622-4018-8c07-77406d18837a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:56.742154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c89b7f7-6622-4018-8c07-77406d18837a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:56.742910 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c89b7f7-6622-4018-8c07-77406d18837a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:56.743341 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c89b7f7-6622-4018-8c07-77406d18837a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:57.162055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f4f28b8a-767e-4e05-bca8-5100c16b0fc9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:57.162651 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f4f28b8a-767e-4e05-bca8-5100c16b0fc9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:57.169714 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f4f28b8a-767e-4e05-bca8-5100c16b0fc9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:57.170159 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f4f28b8a-767e-4e05-bca8-5100c16b0fc9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:57.170922 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f4f28b8a-767e-4e05-bca8-5100c16b0fc9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:57.171357 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f4f28b8a-767e-4e05-bca8-5100c16b0fc9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:57.313564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f4f28b8a-767e-4e05-bca8-5100c16b0fc9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:57.322225 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f4f28b8a-767e-4e05-bca8-5100c16b0fc9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:57.323725 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f4f28b8a-767e-4e05-bca8-5100c16b0fc9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:57.324913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f4f28b8a-767e-4e05-bca8-5100c16b0fc9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.168738 Jul 12 03:53:57.325519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 279/538] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:57 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:58.347551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-083b0693-a549-4640-b879-41b7d9d0d76c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:58.348626 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-083b0693-a549-4640-b879-41b7d9d0d76c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:58.352363 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=50 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:53:58.361787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-083b0693-a549-4640-b879-41b7d9d0d76c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:58.362531 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-083b0693-a549-4640-b879-41b7d9d0d76c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:58.363928 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-083b0693-a549-4640-b879-41b7d9d0d76c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:58.364396 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-083b0693-a549-4640-b879-41b7d9d0d76c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:58.494552 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-083b0693-a549-4640-b879-41b7d9d0d76c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:58.507460 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-083b0693-a549-4640-b879-41b7d9d0d76c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:58.509677 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-083b0693-a549-4640-b879-41b7d9d0d76c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:58.511456 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-083b0693-a549-4640-b879-41b7d9d0d76c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.170160 Jul 12 03:53:58.512187 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 280/539] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:58 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:53:59.537408 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-18a7a226-3002-4231-8457-dfde8d871878 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:53:59.538395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-18a7a226-3002-4231-8457-dfde8d871878 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:53:59.549561 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-18a7a226-3002-4231-8457-dfde8d871878 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:59.550322 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-18a7a226-3002-4231-8457-dfde8d871878 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:59.551626 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-18a7a226-3002-4231-8457-dfde8d871878 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:53:59.552413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-18a7a226-3002-4231-8457-dfde8d871878 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:53:59.698009 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-18a7a226-3002-4231-8457-dfde8d871878 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:59.707552 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-18a7a226-3002-4231-8457-dfde8d871878 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:59.709100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-18a7a226-3002-4231-8457-dfde8d871878 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:53:59.710249 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-18a7a226-3002-4231-8457-dfde8d871878 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.179598 Jul 12 03:53:59.710805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 281/540] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:53:59 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:00.733108 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c11b82aa-bfd6-4d67-ad3f-724a6a20ab3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:00.734143 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c11b82aa-bfd6-4d67-ad3f-724a6a20ab3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:00.742759 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c11b82aa-bfd6-4d67-ad3f-724a6a20ab3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:00.743203 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c11b82aa-bfd6-4d67-ad3f-724a6a20ab3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:00.743985 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c11b82aa-bfd6-4d67-ad3f-724a6a20ab3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:00.744454 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c11b82aa-bfd6-4d67-ad3f-724a6a20ab3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:00.891311 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c11b82aa-bfd6-4d67-ad3f-724a6a20ab3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:00.904502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c11b82aa-bfd6-4d67-ad3f-724a6a20ab3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:00.906720 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c11b82aa-bfd6-4d67-ad3f-724a6a20ab3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:00.908556 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c11b82aa-bfd6-4d67-ad3f-724a6a20ab3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.182024 Jul 12 03:54:00.909253 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 282/541] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:00 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:01.109895 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1c89b7f7-6622-4018-8c07-77406d18837a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "POST /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.379840 Jul 12 03:54:01.110540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 260/542] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 03:53:56 2022] POST /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/os-volume_attachments => generated 194 bytes in 4381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:54:01.927318 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a86839b0-780b-4b8d-b6d9-9ed37f5ba843 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:01.927934 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a86839b0-780b-4b8d-b6d9-9ed37f5ba843 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:01.934852 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a86839b0-780b-4b8d-b6d9-9ed37f5ba843 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:01.935309 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a86839b0-780b-4b8d-b6d9-9ed37f5ba843 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:01.936133 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a86839b0-780b-4b8d-b6d9-9ed37f5ba843 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:01.936606 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a86839b0-780b-4b8d-b6d9-9ed37f5ba843 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:02.077603 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a86839b0-780b-4b8d-b6d9-9ed37f5ba843 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:02.087065 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a86839b0-780b-4b8d-b6d9-9ed37f5ba843 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:02.088625 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a86839b0-780b-4b8d-b6d9-9ed37f5ba843 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:02.089793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a86839b0-780b-4b8d-b6d9-9ed37f5ba843 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.166838 Jul 12 03:54:02.090364 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 283/543] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:01 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:03.109664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-40fdc159-7bcd-460c-9ac2-770cd99c0786 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:03.110373 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-40fdc159-7bcd-460c-9ac2-770cd99c0786 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:03.113461 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=34 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:54:03.117468 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-40fdc159-7bcd-460c-9ac2-770cd99c0786 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:03.117919 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-40fdc159-7bcd-460c-9ac2-770cd99c0786 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:03.118683 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-40fdc159-7bcd-460c-9ac2-770cd99c0786 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:03.119107 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-40fdc159-7bcd-460c-9ac2-770cd99c0786 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:03.262490 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-40fdc159-7bcd-460c-9ac2-770cd99c0786 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:03.271417 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-40fdc159-7bcd-460c-9ac2-770cd99c0786 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:03.272943 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-40fdc159-7bcd-460c-9ac2-770cd99c0786 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:03.274133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-40fdc159-7bcd-460c-9ac2-770cd99c0786 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.169446 Jul 12 03:54:03.274696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 261/544] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:03 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:04.293284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-784c1fc3-92b2-4460-a90f-b3ae44d91a47 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:04.294467 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-784c1fc3-92b2-4460-a90f-b3ae44d91a47 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:04.303327 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-784c1fc3-92b2-4460-a90f-b3ae44d91a47 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:04.304270 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-784c1fc3-92b2-4460-a90f-b3ae44d91a47 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:04.305671 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-784c1fc3-92b2-4460-a90f-b3ae44d91a47 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:04.306317 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-784c1fc3-92b2-4460-a90f-b3ae44d91a47 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:04.449142 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-784c1fc3-92b2-4460-a90f-b3ae44d91a47 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:04.459611 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-784c1fc3-92b2-4460-a90f-b3ae44d91a47 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:04.459611 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-784c1fc3-92b2-4460-a90f-b3ae44d91a47 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:04.460540 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-784c1fc3-92b2-4460-a90f-b3ae44d91a47 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.171743 Jul 12 03:54:04.461302 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 284/545] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:04 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:05.479068 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b86f54ae-7485-408a-9d83-8da887013272 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:05.479679 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b86f54ae-7485-408a-9d83-8da887013272 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:05.486776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b86f54ae-7485-408a-9d83-8da887013272 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:05.487221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b86f54ae-7485-408a-9d83-8da887013272 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:05.487991 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b86f54ae-7485-408a-9d83-8da887013272 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:05.488459 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b86f54ae-7485-408a-9d83-8da887013272 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:05.621724 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b86f54ae-7485-408a-9d83-8da887013272 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:05.630428 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b86f54ae-7485-408a-9d83-8da887013272 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:05.631932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b86f54ae-7485-408a-9d83-8da887013272 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:05.633205 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b86f54ae-7485-408a-9d83-8da887013272 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.158246 Jul 12 03:54:05.633770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 262/546] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:05 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:05.894810 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4d54b246-9c04-49dd-9ca0-90d00a9ed5fe tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:05.895325 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4d54b246-9c04-49dd-9ca0-90d00a9ed5fe tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:05.902466 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4d54b246-9c04-49dd-9ca0-90d00a9ed5fe tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:05.902920 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4d54b246-9c04-49dd-9ca0-90d00a9ed5fe tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:05.903693 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4d54b246-9c04-49dd-9ca0-90d00a9ed5fe tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:05.904161 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4d54b246-9c04-49dd-9ca0-90d00a9ed5fe tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:06.099094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-4d54b246-9c04-49dd-9ca0-90d00a9ed5fe tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lazy-loading 'services' on Instance uuid ba4e504b-f1de-47ca-a7a9-e6e0876eb670 {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:54:06.168157 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:54:06.179622 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4d54b246-9c04-49dd-9ca0-90d00a9ed5fe tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670/os-volume_attachments/1831e325-efc3-4a6f-9d71-e99ecfe06e42" status: 202 len: 0 microversion: 2.1 time: 0.289039 Jul 12 03:54:06.180238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 285/547] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 03:54:05 2022] DELETE /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670/os-volume_attachments/1831e325-efc3-4a6f-9d71-e99ecfe06e42 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:54:06.652837 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8294440b-e75a-4521-be8f-60d7dad7fdf2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:06.654267 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8294440b-e75a-4521-be8f-60d7dad7fdf2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:06.661712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8294440b-e75a-4521-be8f-60d7dad7fdf2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:06.663015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8294440b-e75a-4521-be8f-60d7dad7fdf2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:06.664414 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8294440b-e75a-4521-be8f-60d7dad7fdf2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:06.665028 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8294440b-e75a-4521-be8f-60d7dad7fdf2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:06.807395 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8294440b-e75a-4521-be8f-60d7dad7fdf2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:06.820530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8294440b-e75a-4521-be8f-60d7dad7fdf2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:06.822052 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8294440b-e75a-4521-be8f-60d7dad7fdf2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:06.823206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8294440b-e75a-4521-be8f-60d7dad7fdf2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.174638 Jul 12 03:54:06.823780 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 263/548] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:06 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:07.853022 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-11f20b88-999f-44d4-918d-de180557acdf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:07.853693 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-11f20b88-999f-44d4-918d-de180557acdf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:07.860595 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-11f20b88-999f-44d4-918d-de180557acdf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:07.861050 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-11f20b88-999f-44d4-918d-de180557acdf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:07.861836 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-11f20b88-999f-44d4-918d-de180557acdf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:07.862267 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-11f20b88-999f-44d4-918d-de180557acdf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:08.008622 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-11f20b88-999f-44d4-918d-de180557acdf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:08.017909 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-11f20b88-999f-44d4-918d-de180557acdf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:08.019390 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-11f20b88-999f-44d4-918d-de180557acdf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:08.020578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-11f20b88-999f-44d4-918d-de180557acdf tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.175837 Jul 12 03:54:08.021140 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 286/549] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:07 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:09.039208 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7c45fe8c-764a-40d5-9291-9602f24ed840 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:09.040030 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7c45fe8c-764a-40d5-9291-9602f24ed840 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:09.046822 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c45fe8c-764a-40d5-9291-9602f24ed840 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:09.047274 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c45fe8c-764a-40d5-9291-9602f24ed840 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:09.048050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c45fe8c-764a-40d5-9291-9602f24ed840 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:09.048514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c45fe8c-764a-40d5-9291-9602f24ed840 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:09.253968 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-7c45fe8c-764a-40d5-9291-9602f24ed840 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:09.262800 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-7c45fe8c-764a-40d5-9291-9602f24ed840 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:09.264333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-7c45fe8c-764a-40d5-9291-9602f24ed840 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:09.265494 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7c45fe8c-764a-40d5-9291-9602f24ed840 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.230258 Jul 12 03:54:09.266055 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 264/550] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:09 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:10.285345 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-87657c3b-83bb-4cda-94f9-dcfed70ea765 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:10.285922 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-87657c3b-83bb-4cda-94f9-dcfed70ea765 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:10.292796 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-87657c3b-83bb-4cda-94f9-dcfed70ea765 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:10.293251 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-87657c3b-83bb-4cda-94f9-dcfed70ea765 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:10.293994 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-87657c3b-83bb-4cda-94f9-dcfed70ea765 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:10.294447 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-87657c3b-83bb-4cda-94f9-dcfed70ea765 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:10.442450 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-87657c3b-83bb-4cda-94f9-dcfed70ea765 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:10.452553 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-87657c3b-83bb-4cda-94f9-dcfed70ea765 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:10.455844 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-87657c3b-83bb-4cda-94f9-dcfed70ea765 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:10.457434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-87657c3b-83bb-4cda-94f9-dcfed70ea765 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.176153 Jul 12 03:54:10.469488 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 287/551] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:10 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:11.476554 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9261af7d-9676-40d1-8515-4e9f5a76b1a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:11.477255 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9261af7d-9676-40d1-8515-4e9f5a76b1a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:11.484645 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9261af7d-9676-40d1-8515-4e9f5a76b1a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:11.485125 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9261af7d-9676-40d1-8515-4e9f5a76b1a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:11.485911 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9261af7d-9676-40d1-8515-4e9f5a76b1a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:11.486344 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9261af7d-9676-40d1-8515-4e9f5a76b1a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:11.640114 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9261af7d-9676-40d1-8515-4e9f5a76b1a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:11.651178 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9261af7d-9676-40d1-8515-4e9f5a76b1a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:11.652826 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9261af7d-9676-40d1-8515-4e9f5a76b1a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:11.653988 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9261af7d-9676-40d1-8515-4e9f5a76b1a7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.181670 Jul 12 03:54:11.654562 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 265/552] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:11 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:12.672989 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8955bceb-cc06-42b2-838b-94da15224df7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:12.674855 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8955bceb-cc06-42b2-838b-94da15224df7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:12.682525 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8955bceb-cc06-42b2-838b-94da15224df7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:12.683079 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8955bceb-cc06-42b2-838b-94da15224df7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:12.683916 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8955bceb-cc06-42b2-838b-94da15224df7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:12.684528 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8955bceb-cc06-42b2-838b-94da15224df7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:12.822708 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8955bceb-cc06-42b2-838b-94da15224df7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:12.831418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8955bceb-cc06-42b2-838b-94da15224df7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:12.832934 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8955bceb-cc06-42b2-838b-94da15224df7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:12.834157 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8955bceb-cc06-42b2-838b-94da15224df7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.165740 Jul 12 03:54:12.834614 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 288/553] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:12 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:13.852984 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-72e30990-de29-41de-ac6d-40b4bcfb7907 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:13.853642 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-72e30990-de29-41de-ac6d-40b4bcfb7907 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:13.860338 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-72e30990-de29-41de-ac6d-40b4bcfb7907 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:13.860783 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-72e30990-de29-41de-ac6d-40b4bcfb7907 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:13.861543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-72e30990-de29-41de-ac6d-40b4bcfb7907 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:13.861972 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-72e30990-de29-41de-ac6d-40b4bcfb7907 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:14.002829 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-72e30990-de29-41de-ac6d-40b4bcfb7907 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:14.012296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-72e30990-de29-41de-ac6d-40b4bcfb7907 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:14.014579 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-72e30990-de29-41de-ac6d-40b4bcfb7907 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:14.016214 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-72e30990-de29-41de-ac6d-40b4bcfb7907 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.167251 Jul 12 03:54:14.017511 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 266/554] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:13 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:15.039422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c346585a-881f-4a5c-856f-2ea66768f233 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:15.040602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c346585a-881f-4a5c-856f-2ea66768f233 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:15.047649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c346585a-881f-4a5c-856f-2ea66768f233 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:15.048140 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c346585a-881f-4a5c-856f-2ea66768f233 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:15.048897 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c346585a-881f-4a5c-856f-2ea66768f233 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:15.049315 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c346585a-881f-4a5c-856f-2ea66768f233 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:15.189389 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c346585a-881f-4a5c-856f-2ea66768f233 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:15.199230 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c346585a-881f-4a5c-856f-2ea66768f233 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:15.200806 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c346585a-881f-4a5c-856f-2ea66768f233 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:15.201952 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c346585a-881f-4a5c-856f-2ea66768f233 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.169140 Jul 12 03:54:15.202537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 289/555] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:15 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:16.224589 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d6586d71-78f0-470b-b761-3edd9588d737 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:16.225598 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d6586d71-78f0-470b-b761-3edd9588d737 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:16.236867 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d6586d71-78f0-470b-b761-3edd9588d737 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:16.237620 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d6586d71-78f0-470b-b761-3edd9588d737 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:16.238873 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d6586d71-78f0-470b-b761-3edd9588d737 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:16.239590 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d6586d71-78f0-470b-b761-3edd9588d737 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:16.243885 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:54:16.386565 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d6586d71-78f0-470b-b761-3edd9588d737 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:16.400530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d6586d71-78f0-470b-b761-3edd9588d737 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:16.402039 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d6586d71-78f0-470b-b761-3edd9588d737 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:16.403194 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d6586d71-78f0-470b-b761-3edd9588d737 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.185220 Jul 12 03:54:16.403739 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 267/556] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:16 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:16.962264 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 03:54:16.962566 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Tue Jul 12 03:54:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 03:54:17.550268 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-bb1801d8-35d4-491a-aca6-c8825c0cb81a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:17.550910 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-bb1801d8-35d4-491a-aca6-c8825c0cb81a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:17.557906 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bb1801d8-35d4-491a-aca6-c8825c0cb81a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:17.558352 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bb1801d8-35d4-491a-aca6-c8825c0cb81a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:17.559120 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bb1801d8-35d4-491a-aca6-c8825c0cb81a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:17.559566 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bb1801d8-35d4-491a-aca6-c8825c0cb81a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:17.692530 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-bb1801d8-35d4-491a-aca6-c8825c0cb81a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:17.702468 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-bb1801d8-35d4-491a-aca6-c8825c0cb81a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:17.703986 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-bb1801d8-35d4-491a-aca6-c8825c0cb81a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:17.705202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-bb1801d8-35d4-491a-aca6-c8825c0cb81a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.286380 Jul 12 03:54:17.705801 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 290/557] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:17 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:17.939146 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 03:54:17.939312 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Tue Jul 12 03:54:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 03:54:18.727277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bb83579e-6226-411a-b532-8540b00cb480 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:18.728287 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-bb83579e-6226-411a-b532-8540b00cb480 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:18.739445 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bb83579e-6226-411a-b532-8540b00cb480 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:18.740216 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bb83579e-6226-411a-b532-8540b00cb480 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:18.741391 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bb83579e-6226-411a-b532-8540b00cb480 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:18.742055 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bb83579e-6226-411a-b532-8540b00cb480 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:18.883357 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bb83579e-6226-411a-b532-8540b00cb480 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:18.892264 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bb83579e-6226-411a-b532-8540b00cb480 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:18.894138 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bb83579e-6226-411a-b532-8540b00cb480 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:18.895314 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bb83579e-6226-411a-b532-8540b00cb480 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.174170 Jul 12 03:54:18.895850 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 268/558] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:18 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:19.918452 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2463d620-1c1b-4ab2-b64e-8a34336385bc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:19.919434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2463d620-1c1b-4ab2-b64e-8a34336385bc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:19.930180 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2463d620-1c1b-4ab2-b64e-8a34336385bc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:19.930893 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2463d620-1c1b-4ab2-b64e-8a34336385bc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:19.932372 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2463d620-1c1b-4ab2-b64e-8a34336385bc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:19.933000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2463d620-1c1b-4ab2-b64e-8a34336385bc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:20.073861 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-2463d620-1c1b-4ab2-b64e-8a34336385bc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:20.083342 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-2463d620-1c1b-4ab2-b64e-8a34336385bc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:20.085038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-2463d620-1c1b-4ab2-b64e-8a34336385bc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:20.086200 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2463d620-1c1b-4ab2-b64e-8a34336385bc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.175163 Jul 12 03:54:20.086870 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 291/559] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:19 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:21.104592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-531aa8ed-346f-483a-8541-42f91a4dec63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:21.105196 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-531aa8ed-346f-483a-8541-42f91a4dec63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:21.112295 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-531aa8ed-346f-483a-8541-42f91a4dec63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:21.112742 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-531aa8ed-346f-483a-8541-42f91a4dec63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:21.113530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-531aa8ed-346f-483a-8541-42f91a4dec63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:21.113954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-531aa8ed-346f-483a-8541-42f91a4dec63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:21.244813 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-531aa8ed-346f-483a-8541-42f91a4dec63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:21.253835 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-531aa8ed-346f-483a-8541-42f91a4dec63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:21.255333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-531aa8ed-346f-483a-8541-42f91a4dec63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:21.256536 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-531aa8ed-346f-483a-8541-42f91a4dec63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.156074 Jul 12 03:54:21.257447 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 269/560] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:21 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:22.280198 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7c618452-f907-4398-9009-8e99c4b84642 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:22.281312 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7c618452-f907-4398-9009-8e99c4b84642 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:22.292576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c618452-f907-4398-9009-8e99c4b84642 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:22.293342 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c618452-f907-4398-9009-8e99c4b84642 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:22.294758 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c618452-f907-4398-9009-8e99c4b84642 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:22.295496 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c618452-f907-4398-9009-8e99c4b84642 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:22.434122 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7c618452-f907-4398-9009-8e99c4b84642 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:22.443386 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7c618452-f907-4398-9009-8e99c4b84642 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:22.444940 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7c618452-f907-4398-9009-8e99c4b84642 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:22.446101 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7c618452-f907-4398-9009-8e99c4b84642 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.172692 Jul 12 03:54:22.446632 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 292/561] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:22 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:23.468741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-cc83ea43-8e36-4dc7-a1a8-c3b64eaa055c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:23.469540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-cc83ea43-8e36-4dc7-a1a8-c3b64eaa055c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:23.480632 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cc83ea43-8e36-4dc7-a1a8-c3b64eaa055c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:23.481080 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cc83ea43-8e36-4dc7-a1a8-c3b64eaa055c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:23.482069 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cc83ea43-8e36-4dc7-a1a8-c3b64eaa055c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:23.482228 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cc83ea43-8e36-4dc7-a1a8-c3b64eaa055c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:23.615499 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-cc83ea43-8e36-4dc7-a1a8-c3b64eaa055c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:23.626321 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-cc83ea43-8e36-4dc7-a1a8-c3b64eaa055c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:23.627841 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-cc83ea43-8e36-4dc7-a1a8-c3b64eaa055c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:23.629032 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-cc83ea43-8e36-4dc7-a1a8-c3b64eaa055c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.166950 Jul 12 03:54:23.629564 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 270/562] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:23 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:24.651912 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4590a90f-cbe5-486d-995e-c17355ded0df tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:24.652962 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4590a90f-cbe5-486d-995e-c17355ded0df tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:24.660512 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4590a90f-cbe5-486d-995e-c17355ded0df tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:24.660965 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4590a90f-cbe5-486d-995e-c17355ded0df tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:24.661739 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4590a90f-cbe5-486d-995e-c17355ded0df tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:24.662174 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4590a90f-cbe5-486d-995e-c17355ded0df tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:24.807655 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4590a90f-cbe5-486d-995e-c17355ded0df tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:24.821355 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4590a90f-cbe5-486d-995e-c17355ded0df tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:24.823888 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4590a90f-cbe5-486d-995e-c17355ded0df tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:24.825744 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4590a90f-cbe5-486d-995e-c17355ded0df tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.180298 Jul 12 03:54:24.826304 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 293/563] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:24 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:25.848542 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-99044504-81ea-4c0a-a903-24d22f1760f0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:25.849544 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-99044504-81ea-4c0a-a903-24d22f1760f0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:25.860789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-99044504-81ea-4c0a-a903-24d22f1760f0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:25.861535 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-99044504-81ea-4c0a-a903-24d22f1760f0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:25.862790 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-99044504-81ea-4c0a-a903-24d22f1760f0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:25.863505 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-99044504-81ea-4c0a-a903-24d22f1760f0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:26.003168 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-99044504-81ea-4c0a-a903-24d22f1760f0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:26.012786 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-99044504-81ea-4c0a-a903-24d22f1760f0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:26.014305 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-99044504-81ea-4c0a-a903-24d22f1760f0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:26.015460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-99044504-81ea-4c0a-a903-24d22f1760f0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.173543 Jul 12 03:54:26.016044 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 271/564] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:25 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:27.033686 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9bb03407-e482-445f-8672-f8a7b2dfdde5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:27.034273 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-9bb03407-e482-445f-8672-f8a7b2dfdde5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:27.041392 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9bb03407-e482-445f-8672-f8a7b2dfdde5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:27.041868 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9bb03407-e482-445f-8672-f8a7b2dfdde5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:27.042809 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9bb03407-e482-445f-8672-f8a7b2dfdde5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:27.043417 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9bb03407-e482-445f-8672-f8a7b2dfdde5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:27.181427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9bb03407-e482-445f-8672-f8a7b2dfdde5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:27.189970 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9bb03407-e482-445f-8672-f8a7b2dfdde5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:27.191451 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9bb03407-e482-445f-8672-f8a7b2dfdde5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:27.192635 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9bb03407-e482-445f-8672-f8a7b2dfdde5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.162964 Jul 12 03:54:27.193182 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 294/565] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:27 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:27.717877 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b14087a9-0174-452e-986d-8c61519d7b39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:54:27.724757 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b14087a9-0174-452e-986d-8c61519d7b39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:27.725199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b14087a9-0174-452e-986d-8c61519d7b39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:27.786042 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b14087a9-0174-452e-986d-8c61519d7b39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Going to try to stop instance {{(pid=124435) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 03:54:27.829295 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b14087a9-0174-452e-986d-8c61519d7b39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "POST /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/action" status: 202 len: 0 microversion: 2.1 time: 0.115338 Jul 12 03:54:27.829917 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 272/566] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 03:54:27 2022] POST /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:54:27.840147 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d891379f-cdaf-4425-8ebf-4db75e071675 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:27.840785 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d891379f-cdaf-4425-8ebf-4db75e071675 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:27.851021 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d891379f-cdaf-4425-8ebf-4db75e071675 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:27.851683 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d891379f-cdaf-4425-8ebf-4db75e071675 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:27.852536 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d891379f-cdaf-4425-8ebf-4db75e071675 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:27.852960 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d891379f-cdaf-4425-8ebf-4db75e071675 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:27.999118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d891379f-cdaf-4425-8ebf-4db75e071675 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:28.008054 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d891379f-cdaf-4425-8ebf-4db75e071675 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.173719 Jul 12 03:54:28.008710 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 295/567] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:27 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:54:28.211656 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bc13378d-9672-441c-93e4-b4373705972e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:28.212281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-bc13378d-9672-441c-93e4-b4373705972e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:28.219069 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bc13378d-9672-441c-93e4-b4373705972e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:28.219519 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bc13378d-9672-441c-93e4-b4373705972e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:28.220324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bc13378d-9672-441c-93e4-b4373705972e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:28.220759 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bc13378d-9672-441c-93e4-b4373705972e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:28.357930 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bc13378d-9672-441c-93e4-b4373705972e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:28.367070 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bc13378d-9672-441c-93e4-b4373705972e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:28.368584 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bc13378d-9672-441c-93e4-b4373705972e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:28.369763 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bc13378d-9672-441c-93e4-b4373705972e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.162642 Jul 12 03:54:28.370323 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 273/568] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:28 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:28.550913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-31404401-d3bf-48d7-8421-963a8860d30f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:28.551457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-31404401-d3bf-48d7-8421-963a8860d30f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:28.553785 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=32 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:54:28.561654 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-31404401-d3bf-48d7-8421-963a8860d30f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:28.562305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-31404401-d3bf-48d7-8421-963a8860d30f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:28.563689 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-31404401-d3bf-48d7-8421-963a8860d30f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:28.564354 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-31404401-d3bf-48d7-8421-963a8860d30f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:28.595357 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-31404401-d3bf-48d7-8421-963a8860d30f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Going to try to terminate instance {{(pid=124434) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:54:28.681257 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-31404401-d3bf-48d7-8421-963a8860d30f tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 204 len: 0 microversion: 2.1 time: 0.133700 Jul 12 03:54:28.681955 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 296/569] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:54:28 2022] DELETE /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:54:28.690918 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e262363e-4d37-49c9-9a55-108052dddfb8 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:28.691526 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e262363e-4d37-49c9-9a55-108052dddfb8 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:28.697834 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e262363e-4d37-49c9-9a55-108052dddfb8 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:28.698280 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e262363e-4d37-49c9-9a55-108052dddfb8 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:28.699042 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e262363e-4d37-49c9-9a55-108052dddfb8 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:28.699476 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e262363e-4d37-49c9-9a55-108052dddfb8 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:28.838144 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e262363e-4d37-49c9-9a55-108052dddfb8 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:28.846072 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e262363e-4d37-49c9-9a55-108052dddfb8 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1514 microversion: 2.1 time: 0.159550 Jul 12 03:54:28.846665 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 274/570] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:28 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:54:29.030228 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-516ea52f-ab4d-4f6f-9c32-35f8b34b64ee tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:29.031414 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-516ea52f-ab4d-4f6f-9c32-35f8b34b64ee tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:29.038254 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-516ea52f-ab4d-4f6f-9c32-35f8b34b64ee tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:29.038627 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-516ea52f-ab4d-4f6f-9c32-35f8b34b64ee tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:29.039380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-516ea52f-ab4d-4f6f-9c32-35f8b34b64ee tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:29.039807 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-516ea52f-ab4d-4f6f-9c32-35f8b34b64ee tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:29.187272 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-516ea52f-ab4d-4f6f-9c32-35f8b34b64ee tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:29.198896 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-516ea52f-ab4d-4f6f-9c32-35f8b34b64ee tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.175667 Jul 12 03:54:29.199631 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 297/571] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:29 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:29.365291 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-ff9cbf16-a77c-461f-9246-0fea224a99d1 req-a29ce3b5-4562-431e-ab3d-78e6cacb0102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae771f5b-03de-46db-82fc-cd94d731405a", "name": "network-vif-plugged", "status": "completed", "tag": "28823cfb-b758-4345-b841-353bcf53f8b8"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:54:29.374935 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-ff9cbf16-a77c-461f-9246-0fea224a99d1 req-a29ce3b5-4562-431e-ab3d-78e6cacb0102 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:29.375367 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-ff9cbf16-a77c-461f-9246-0fea224a99d1 req-a29ce3b5-4562-431e-ab3d-78e6cacb0102 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:29.388521 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-ff9cbf16-a77c-461f-9246-0fea224a99d1 req-a29ce3b5-4562-431e-ab3d-78e6cacb0102 service nova] Creating event network-vif-plugged:28823cfb-b758-4345-b841-353bcf53f8b8 for instance ae771f5b-03de-46db-82fc-cd94d731405a on hv-cinder-84773 Jul 12 03:54:29.389498 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a272a730-9e38-45ce-a1cc-c496f15b06aa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:29.390107 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a272a730-9e38-45ce-a1cc-c496f15b06aa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:29.393815 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-ff9cbf16-a77c-461f-9246-0fea224a99d1 req-a29ce3b5-4562-431e-ab3d-78e6cacb0102 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031991 Jul 12 03:54:29.394413 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 275/572] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:54:29.398246 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a272a730-9e38-45ce-a1cc-c496f15b06aa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:29.398695 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a272a730-9e38-45ce-a1cc-c496f15b06aa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:29.399467 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a272a730-9e38-45ce-a1cc-c496f15b06aa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:29.399902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a272a730-9e38-45ce-a1cc-c496f15b06aa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:29.546885 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a272a730-9e38-45ce-a1cc-c496f15b06aa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:29.555936 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a272a730-9e38-45ce-a1cc-c496f15b06aa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:29.557495 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a272a730-9e38-45ce-a1cc-c496f15b06aa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:29.558666 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a272a730-9e38-45ce-a1cc-c496f15b06aa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.174237 Jul 12 03:54:29.559596 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 298/573] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:29 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:29.866329 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-dfccde42-b314-4cb4-8937-5c2330494300 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:29.867142 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-dfccde42-b314-4cb4-8937-5c2330494300 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:29.875045 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dfccde42-b314-4cb4-8937-5c2330494300 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:29.875592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dfccde42-b314-4cb4-8937-5c2330494300 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:29.876542 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dfccde42-b314-4cb4-8937-5c2330494300 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:29.877053 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-dfccde42-b314-4cb4-8937-5c2330494300 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:30.015700 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-dfccde42-b314-4cb4-8937-5c2330494300 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:30.024220 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-dfccde42-b314-4cb4-8937-5c2330494300 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1514 microversion: 2.1 time: 0.163365 Jul 12 03:54:30.024791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 276/574] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:29 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:30.219240 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d7d505d1-0c98-4ea5-bfea-08aa24eb8267 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:30.219871 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d7d505d1-0c98-4ea5-bfea-08aa24eb8267 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:30.226915 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d7d505d1-0c98-4ea5-bfea-08aa24eb8267 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:30.227355 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d7d505d1-0c98-4ea5-bfea-08aa24eb8267 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:30.228176 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d7d505d1-0c98-4ea5-bfea-08aa24eb8267 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:30.228614 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d7d505d1-0c98-4ea5-bfea-08aa24eb8267 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:30.365418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d7d505d1-0c98-4ea5-bfea-08aa24eb8267 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:30.377635 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d7d505d1-0c98-4ea5-bfea-08aa24eb8267 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.164414 Jul 12 03:54:30.378211 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 299/575] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:30 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:30.577907 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e63789f2-49fc-4dc7-a411-c387e640c2dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:30.578655 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e63789f2-49fc-4dc7-a411-c387e640c2dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:30.586652 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e63789f2-49fc-4dc7-a411-c387e640c2dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:30.587148 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e63789f2-49fc-4dc7-a411-c387e640c2dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:30.587973 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e63789f2-49fc-4dc7-a411-c387e640c2dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:30.588442 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e63789f2-49fc-4dc7-a411-c387e640c2dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:30.721422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e63789f2-49fc-4dc7-a411-c387e640c2dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:30.730060 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e63789f2-49fc-4dc7-a411-c387e640c2dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:30.731538 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e63789f2-49fc-4dc7-a411-c387e640c2dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:30.732711 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e63789f2-49fc-4dc7-a411-c387e640c2dd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.159459 Jul 12 03:54:30.733274 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 277/576] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:30 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:31.041329 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7666416f-ff15-47e1-b111-fd3f44daa210 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:31.041995 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7666416f-ff15-47e1-b111-fd3f44daa210 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:31.048899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7666416f-ff15-47e1-b111-fd3f44daa210 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:31.048899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7666416f-ff15-47e1-b111-fd3f44daa210 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:31.049314 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7666416f-ff15-47e1-b111-fd3f44daa210 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:31.049750 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7666416f-ff15-47e1-b111-fd3f44daa210 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:31.181159 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7666416f-ff15-47e1-b111-fd3f44daa210 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:31.184713 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:54:31.190153 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7666416f-ff15-47e1-b111-fd3f44daa210 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1514 microversion: 2.1 time: 0.152692 Jul 12 03:54:31.190730 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 300/577] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:31 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:31.368044 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-a6f34920-7cd2-4fcf-ae92-9508ed828560 req-f66d258a-ae8f-43f3-9975-d1fd9c2b42da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba4e504b-f1de-47ca-a7a9-e6e0876eb670", "name": "network-vif-deleted", "tag": "027b88e5-15ff-4542-ae28-472d408f62f4"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:54:31.376479 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-a6f34920-7cd2-4fcf-ae92-9508ed828560 req-f66d258a-ae8f-43f3-9975-d1fd9c2b42da service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:31.376900 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-a6f34920-7cd2-4fcf-ae92-9508ed828560 req-f66d258a-ae8f-43f3-9975-d1fd9c2b42da service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:31.388207 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-a6f34920-7cd2-4fcf-ae92-9508ed828560 req-f66d258a-ae8f-43f3-9975-d1fd9c2b42da service nova] Creating event network-vif-deleted:027b88e5-15ff-4542-ae28-472d408f62f4 for instance ba4e504b-f1de-47ca-a7a9-e6e0876eb670 on hv-cinder-84773 Jul 12 03:54:31.393563 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-a6f34920-7cd2-4fcf-ae92-9508ed828560 req-f66d258a-ae8f-43f3-9975-d1fd9c2b42da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028821 Jul 12 03:54:31.394132 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 278/578] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:54:31.398579 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-70f4ba70-7c29-4b14-8abb-03ba2b459cf3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:31.399194 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-70f4ba70-7c29-4b14-8abb-03ba2b459cf3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:31.407010 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-70f4ba70-7c29-4b14-8abb-03ba2b459cf3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:31.407456 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-70f4ba70-7c29-4b14-8abb-03ba2b459cf3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:31.408246 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-70f4ba70-7c29-4b14-8abb-03ba2b459cf3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:31.408677 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-70f4ba70-7c29-4b14-8abb-03ba2b459cf3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:31.558133 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-70f4ba70-7c29-4b14-8abb-03ba2b459cf3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:31.570844 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-70f4ba70-7c29-4b14-8abb-03ba2b459cf3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.176667 Jul 12 03:54:31.571715 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 301/579] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:31 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:31.756561 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-084b810c-a8bb-4466-aea8-c21a994ff9c1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:31.757282 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-084b810c-a8bb-4466-aea8-c21a994ff9c1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:31.769158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-084b810c-a8bb-4466-aea8-c21a994ff9c1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:31.769896 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-084b810c-a8bb-4466-aea8-c21a994ff9c1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:31.771187 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-084b810c-a8bb-4466-aea8-c21a994ff9c1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:31.771903 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-084b810c-a8bb-4466-aea8-c21a994ff9c1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:31.910803 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-084b810c-a8bb-4466-aea8-c21a994ff9c1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:31.921074 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-084b810c-a8bb-4466-aea8-c21a994ff9c1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:31.922584 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-084b810c-a8bb-4466-aea8-c21a994ff9c1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:31.923747 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-084b810c-a8bb-4466-aea8-c21a994ff9c1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.175133 Jul 12 03:54:31.924398 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 279/580] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:31 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:32.208476 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-845002e5-724a-469c-b717-dd1db9890716 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:32.209100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-845002e5-724a-469c-b717-dd1db9890716 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:32.215462 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-845002e5-724a-469c-b717-dd1db9890716 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:32.215903 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-845002e5-724a-469c-b717-dd1db9890716 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:32.216692 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-845002e5-724a-469c-b717-dd1db9890716 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:32.217105 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-845002e5-724a-469c-b717-dd1db9890716 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:32.247567 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-845002e5-724a-469c-b717-dd1db9890716 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:32.247995 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-845002e5-724a-469c-b717-dd1db9890716 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:32.248464 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-845002e5-724a-469c-b717-dd1db9890716 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lazy-loading 'fault' on Instance uuid ba4e504b-f1de-47ca-a7a9-e6e0876eb670 {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:54:32.290051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-845002e5-724a-469c-b717-dd1db9890716 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e27cbb381174481ade02b228faa8fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2e5f7d1e2e4aa3a98bbbf89a6ec276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:32.297712 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-845002e5-724a-469c-b717-dd1db9890716 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 200 len: 1309 microversion: 2.1 time: 0.093094 Jul 12 03:54:32.298319 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 302/581] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:32 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:32.589069 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a3c04d32-b92f-463e-a1b0-4959df2e7321 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:32.589878 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a3c04d32-b92f-463e-a1b0-4959df2e7321 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:32.599433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a3c04d32-b92f-463e-a1b0-4959df2e7321 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:32.600054 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a3c04d32-b92f-463e-a1b0-4959df2e7321 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:32.601129 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a3c04d32-b92f-463e-a1b0-4959df2e7321 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:32.601652 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a3c04d32-b92f-463e-a1b0-4959df2e7321 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:32.741411 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a3c04d32-b92f-463e-a1b0-4959df2e7321 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:32.749578 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a3c04d32-b92f-463e-a1b0-4959df2e7321 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.164998 Jul 12 03:54:32.750234 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 280/582] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:32 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:32.947875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b4198d58-63b6-4296-b056-36628410cb3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:32.948893 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b4198d58-63b6-4296-b056-36628410cb3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:32.957177 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b4198d58-63b6-4296-b056-36628410cb3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:32.957624 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b4198d58-63b6-4296-b056-36628410cb3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:32.958373 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b4198d58-63b6-4296-b056-36628410cb3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:32.958990 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b4198d58-63b6-4296-b056-36628410cb3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:33.088125 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b4198d58-63b6-4296-b056-36628410cb3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:33.096985 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b4198d58-63b6-4296-b056-36628410cb3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:33.098670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b4198d58-63b6-4296-b056-36628410cb3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:33.099910 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b4198d58-63b6-4296-b056-36628410cb3c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1808 microversion: 2.20 time: 0.156528 Jul 12 03:54:33.100547 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 303/583] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:32 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:33.315029 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fd923314-6c4f-4a8a-925c-da9eb0a4b717 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:33.315699 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-fd923314-6c4f-4a8a-925c-da9eb0a4b717 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] [instance: ba4e504b-f1de-47ca-a7a9-e6e0876eb670] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:33.318232 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=40 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:54:33.324212 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fd923314-6c4f-4a8a-925c-da9eb0a4b717 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:33.324662 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fd923314-6c4f-4a8a-925c-da9eb0a4b717 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:33.325471 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fd923314-6c4f-4a8a-925c-da9eb0a4b717 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:33.325907 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fd923314-6c4f-4a8a-925c-da9eb0a4b717 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:33.339419 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-fd923314-6c4f-4a8a-925c-da9eb0a4b717 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] HTTP exception thrown: Instance ba4e504b-f1de-47ca-a7a9-e6e0876eb670 could not be found. Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fd923314-6c4f-4a8a-925c-da9eb0a4b717 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Request method failure captured: Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 HTTP/1.1 Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO_Dt2rHA0KfAlZx-Y1yZTbJAbpkeRmf-Rt-3HWZcEYA8gZeXVKXvTtVmuVUDx9KoWs91IxfH6jVIVwWrZZ3Mdc58iFdNBa2AwJGotb7EsuKr74AFCUgt5KadmZTXFv99jvyozJoIDvvQcPYAu_LFS7K18oXvxUutJ8lWaBz-yYRP0E Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: cd2e5f7d1e2e4aa3a98bbbf89a6ec276 Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1822208826 Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:54:33.340999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:54:33.342556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cd2e5f7d1e2e4aa3a98bbbf89a6ec276"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cd2e5f7d1e2e4aa3a98bbbf89a6ec276"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd2e5f7d1e2e4aa3a98bbbf89a6ec276"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cd2e5f7d1e2e4aa3a98bbbf89a6ec276"}]}] Jul 12 03:54:33.342556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-VolumesSnapshotTestJSON-1822208826 Jul 12 03:54:33.342556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: cd2e5f7d1e2e4aa3a98bbbf89a6ec276 Jul 12 03:54:33.342556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1822208826 Jul 12 03:54:33.342556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-VolumesSnapshotTestJSON-1822208826-project Jul 12 03:54:33.342556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:54:33.342556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:54:33.342556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 9e27cbb381174481ade02b228faa8fb8 Jul 12 03:54:33.342556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-VolumesSnapshotTestJSON-1822208826-project Jul 12 03:54:33.342556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 03:54:33.342556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance ba4e504b-f1de-47ca-a7a9-e6e0876eb670 could not be found. Jul 12 03:54:33.342556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'ba4e504b-f1de-47ca-a7a9-e6e0876eb670'} Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba4e504b-f1de-47ca-a7a9-e6e0876eb670 could not be found. Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:54:33.343396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba4e504b-f1de-47ca-a7a9-e6e0876eb670 could not be found. Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba4e504b-f1de-47ca-a7a9-e6e0876eb670 could not be found. Jul 12 03:54:33.345171 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:54:33.346388 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fd923314-6c4f-4a8a-925c-da9eb0a4b717 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] Returning 404 to user: Instance ba4e504b-f1de-47ca-a7a9-e6e0876eb670 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:54:33.346388 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-fd923314-6c4f-4a8a-925c-da9eb0a4b717 tempest-VolumesSnapshotTestJSON-1822208826 tempest-VolumesSnapshotTestJSON-1822208826-project] 10.222.0.20 "GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670" status: 404 len: 111 microversion: 2.1 time: 0.031438 Jul 12 03:54:33.346388 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 281/584] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:33 2022] GET /compute/v2.1/servers/ba4e504b-f1de-47ca-a7a9-e6e0876eb670 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:54:33.770580 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0d5826dd-2d5f-4cca-8b10-479a65945425 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:33.771196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0d5826dd-2d5f-4cca-8b10-479a65945425 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:33.777425 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d5826dd-2d5f-4cca-8b10-479a65945425 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:33.777920 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d5826dd-2d5f-4cca-8b10-479a65945425 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:33.778674 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d5826dd-2d5f-4cca-8b10-479a65945425 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:33.779104 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d5826dd-2d5f-4cca-8b10-479a65945425 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:33.916961 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0d5826dd-2d5f-4cca-8b10-479a65945425 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:33.925298 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0d5826dd-2d5f-4cca-8b10-479a65945425 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.159955 Jul 12 03:54:33.925867 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 304/585] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:33 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:34.123067 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d7a3176e-5746-4f41-bb39-232e6577f0f7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:34.123867 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d7a3176e-5746-4f41-bb39-232e6577f0f7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:34.131670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d7a3176e-5746-4f41-bb39-232e6577f0f7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:34.132136 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d7a3176e-5746-4f41-bb39-232e6577f0f7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:34.132890 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d7a3176e-5746-4f41-bb39-232e6577f0f7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:34.133316 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d7a3176e-5746-4f41-bb39-232e6577f0f7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:34.269620 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d7a3176e-5746-4f41-bb39-232e6577f0f7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:34.278703 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d7a3176e-5746-4f41-bb39-232e6577f0f7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:34.280221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d7a3176e-5746-4f41-bb39-232e6577f0f7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:34.281353 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d7a3176e-5746-4f41-bb39-232e6577f0f7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1795 microversion: 2.20 time: 0.165013 Jul 12 03:54:34.281978 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 282/586] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:54:34 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1795 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:54:34.943121 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ddb75343-350b-4dc6-b508-5410202507d0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:34.943711 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ddb75343-350b-4dc6-b508-5410202507d0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:34.950639 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ddb75343-350b-4dc6-b508-5410202507d0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:34.951088 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ddb75343-350b-4dc6-b508-5410202507d0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:34.951849 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ddb75343-350b-4dc6-b508-5410202507d0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:34.952309 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ddb75343-350b-4dc6-b508-5410202507d0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:35.084801 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ddb75343-350b-4dc6-b508-5410202507d0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:35.093420 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ddb75343-350b-4dc6-b508-5410202507d0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.154349 Jul 12 03:54:35.094009 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 305/587] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:34 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:36.113232 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b7219775-f0f1-445b-a534-75dd437b84ce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:36.113774 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b7219775-f0f1-445b-a534-75dd437b84ce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:36.120920 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b7219775-f0f1-445b-a534-75dd437b84ce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:36.121359 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b7219775-f0f1-445b-a534-75dd437b84ce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:36.122128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b7219775-f0f1-445b-a534-75dd437b84ce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:36.122562 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b7219775-f0f1-445b-a534-75dd437b84ce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:36.255381 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b7219775-f0f1-445b-a534-75dd437b84ce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:36.264981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b7219775-f0f1-445b-a534-75dd437b84ce tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.156858 Jul 12 03:54:36.265556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 283/588] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:36 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:37.286911 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9c14f4d5-f8a0-4e6c-b005-1384a5fc40bc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:37.287789 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-9c14f4d5-f8a0-4e6c-b005-1384a5fc40bc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:37.299060 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9c14f4d5-f8a0-4e6c-b005-1384a5fc40bc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:37.299795 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9c14f4d5-f8a0-4e6c-b005-1384a5fc40bc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:37.301098 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9c14f4d5-f8a0-4e6c-b005-1384a5fc40bc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:37.301816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9c14f4d5-f8a0-4e6c-b005-1384a5fc40bc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:37.440781 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9c14f4d5-f8a0-4e6c-b005-1384a5fc40bc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:37.449183 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9c14f4d5-f8a0-4e6c-b005-1384a5fc40bc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.169211 Jul 12 03:54:37.449799 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 306/589] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:37 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:38.470541 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-605c37eb-30a3-4f8f-8055-401dd202bceb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:38.471181 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-605c37eb-30a3-4f8f-8055-401dd202bceb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:38.478218 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-605c37eb-30a3-4f8f-8055-401dd202bceb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:38.478639 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-605c37eb-30a3-4f8f-8055-401dd202bceb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:38.479399 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-605c37eb-30a3-4f8f-8055-401dd202bceb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:38.479838 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-605c37eb-30a3-4f8f-8055-401dd202bceb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:38.614810 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-605c37eb-30a3-4f8f-8055-401dd202bceb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:38.617068 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:54:38.624565 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-605c37eb-30a3-4f8f-8055-401dd202bceb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.160072 Jul 12 03:54:38.625080 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 284/590] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:38 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:39.646543 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c4ecd16f-4f8f-4206-84fe-075210e0933c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:39.647546 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c4ecd16f-4f8f-4206-84fe-075210e0933c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:39.658845 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4ecd16f-4f8f-4206-84fe-075210e0933c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:39.659660 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4ecd16f-4f8f-4206-84fe-075210e0933c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:39.660982 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4ecd16f-4f8f-4206-84fe-075210e0933c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:39.661708 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4ecd16f-4f8f-4206-84fe-075210e0933c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:39.807101 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c4ecd16f-4f8f-4206-84fe-075210e0933c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:39.815815 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c4ecd16f-4f8f-4206-84fe-075210e0933c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.176281 Jul 12 03:54:39.816439 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 307/591] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:39 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:40.838926 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-172f58b3-fb21-43b4-916f-a62b6bede77c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:40.839852 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-172f58b3-fb21-43b4-916f-a62b6bede77c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:40.849505 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-172f58b3-fb21-43b4-916f-a62b6bede77c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:40.849957 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-172f58b3-fb21-43b4-916f-a62b6bede77c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:40.850716 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-172f58b3-fb21-43b4-916f-a62b6bede77c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:40.851145 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-172f58b3-fb21-43b4-916f-a62b6bede77c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:40.991515 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-172f58b3-fb21-43b4-916f-a62b6bede77c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:40.999709 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-172f58b3-fb21-43b4-916f-a62b6bede77c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.168808 Jul 12 03:54:41.000315 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 285/592] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:40 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:42.017297 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d6842823-5bb3-4c85-9bee-2d065fc2e357 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:42.017923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d6842823-5bb3-4c85-9bee-2d065fc2e357 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:42.025287 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d6842823-5bb3-4c85-9bee-2d065fc2e357 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:42.025738 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d6842823-5bb3-4c85-9bee-2d065fc2e357 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:42.026513 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d6842823-5bb3-4c85-9bee-2d065fc2e357 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:42.026948 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d6842823-5bb3-4c85-9bee-2d065fc2e357 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:42.164221 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d6842823-5bb3-4c85-9bee-2d065fc2e357 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:42.175801 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d6842823-5bb3-4c85-9bee-2d065fc2e357 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.162506 Jul 12 03:54:42.176407 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 308/593] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:42 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:43.197271 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-15186b95-166f-45eb-8b49-b7f3befe1c2a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:43.197836 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-15186b95-166f-45eb-8b49-b7f3befe1c2a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:43.207112 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-15186b95-166f-45eb-8b49-b7f3befe1c2a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:43.207664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-15186b95-166f-45eb-8b49-b7f3befe1c2a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:43.208851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-15186b95-166f-45eb-8b49-b7f3befe1c2a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:43.209477 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-15186b95-166f-45eb-8b49-b7f3befe1c2a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:43.343894 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-15186b95-166f-45eb-8b49-b7f3befe1c2a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:43.356428 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-15186b95-166f-45eb-8b49-b7f3befe1c2a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.165539 Jul 12 03:54:43.357363 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 286/594] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:43 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:44.379227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-759a90e9-cd28-4317-9b74-72e3fc784623 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:44.380311 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-759a90e9-cd28-4317-9b74-72e3fc784623 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:44.391531 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-759a90e9-cd28-4317-9b74-72e3fc784623 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:44.392408 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-759a90e9-cd28-4317-9b74-72e3fc784623 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:44.393827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-759a90e9-cd28-4317-9b74-72e3fc784623 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:44.394265 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-759a90e9-cd28-4317-9b74-72e3fc784623 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:44.527000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-759a90e9-cd28-4317-9b74-72e3fc784623 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:44.535358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-759a90e9-cd28-4317-9b74-72e3fc784623 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.162898 Jul 12 03:54:44.535927 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 309/595] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:44 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:45.553812 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-20be6b1a-c87f-4878-bc4b-732ae17c2e45 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:45.554526 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-20be6b1a-c87f-4878-bc4b-732ae17c2e45 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:45.562723 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-20be6b1a-c87f-4878-bc4b-732ae17c2e45 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:45.563262 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-20be6b1a-c87f-4878-bc4b-732ae17c2e45 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:45.564214 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-20be6b1a-c87f-4878-bc4b-732ae17c2e45 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:45.564849 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-20be6b1a-c87f-4878-bc4b-732ae17c2e45 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:45.703127 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-20be6b1a-c87f-4878-bc4b-732ae17c2e45 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:45.711788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-20be6b1a-c87f-4878-bc4b-732ae17c2e45 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.162574 Jul 12 03:54:45.712397 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 287/596] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:45 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:46.733289 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-bf978ba7-4f0b-4a11-a209-cc5448a6399c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:46.734324 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-bf978ba7-4f0b-4a11-a209-cc5448a6399c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:46.745527 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bf978ba7-4f0b-4a11-a209-cc5448a6399c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:46.746276 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bf978ba7-4f0b-4a11-a209-cc5448a6399c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:46.747537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bf978ba7-4f0b-4a11-a209-cc5448a6399c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:46.748326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bf978ba7-4f0b-4a11-a209-cc5448a6399c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:46.881317 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-bf978ba7-4f0b-4a11-a209-cc5448a6399c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:46.890145 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-bf978ba7-4f0b-4a11-a209-cc5448a6399c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.163437 Jul 12 03:54:46.890698 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 310/597] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:46 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:47.914023 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e5657907-5b46-49f4-9245-43fa622076cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:47.915062 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e5657907-5b46-49f4-9245-43fa622076cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:47.925618 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e5657907-5b46-49f4-9245-43fa622076cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:47.926067 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e5657907-5b46-49f4-9245-43fa622076cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:47.926831 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e5657907-5b46-49f4-9245-43fa622076cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:47.927264 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e5657907-5b46-49f4-9245-43fa622076cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:48.062760 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e5657907-5b46-49f4-9245-43fa622076cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:48.071607 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e5657907-5b46-49f4-9245-43fa622076cc tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.164048 Jul 12 03:54:48.072289 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 288/598] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:47 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:49.093040 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-710a6b9c-7803-4877-82ec-328ac39381ba tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:49.093643 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-710a6b9c-7803-4877-82ec-328ac39381ba tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:49.104605 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-710a6b9c-7803-4877-82ec-328ac39381ba tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:49.105282 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-710a6b9c-7803-4877-82ec-328ac39381ba tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:49.106581 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-710a6b9c-7803-4877-82ec-328ac39381ba tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:49.107063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-710a6b9c-7803-4877-82ec-328ac39381ba tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:49.245436 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-710a6b9c-7803-4877-82ec-328ac39381ba tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:49.254056 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-710a6b9c-7803-4877-82ec-328ac39381ba tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.167148 Jul 12 03:54:49.254614 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 311/599] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:49 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:50.274367 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c7dbbeba-ca8c-4e2e-a456-53fa2abbffbd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:50.275145 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c7dbbeba-ca8c-4e2e-a456-53fa2abbffbd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:50.285522 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c7dbbeba-ca8c-4e2e-a456-53fa2abbffbd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:50.286215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c7dbbeba-ca8c-4e2e-a456-53fa2abbffbd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:50.287399 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c7dbbeba-ca8c-4e2e-a456-53fa2abbffbd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:50.288248 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c7dbbeba-ca8c-4e2e-a456-53fa2abbffbd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:50.421112 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c7dbbeba-ca8c-4e2e-a456-53fa2abbffbd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:50.430571 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c7dbbeba-ca8c-4e2e-a456-53fa2abbffbd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.162583 Jul 12 03:54:50.431139 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 289/600] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:50 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:50.959184 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a95356e4-6a45-43ca-baf5-6832b1f800c0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0875ffcb-cea6-42fa-9d27-e78ae883f412"}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:54:50.960344 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a95356e4-6a45-43ca-baf5-6832b1f800c0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:50.966592 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a95356e4-6a45-43ca-baf5-6832b1f800c0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:50.967003 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a95356e4-6a45-43ca-baf5-6832b1f800c0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:50.967800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a95356e4-6a45-43ca-baf5-6832b1f800c0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:50.968271 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a95356e4-6a45-43ca-baf5-6832b1f800c0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:51.239633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a95356e4-6a45-43ca-baf5-6832b1f800c0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "POST /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.403596 Jul 12 03:54:51.240406 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 312/601] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 03:54:50 2022] POST /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-volume_attachments => generated 194 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:54:51.448087 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-76d989ee-fd7a-4efb-872a-a53ca00d814f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:51.448722 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-76d989ee-fd7a-4efb-872a-a53ca00d814f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:51.455514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-76d989ee-fd7a-4efb-872a-a53ca00d814f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:51.455949 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-76d989ee-fd7a-4efb-872a-a53ca00d814f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:51.456737 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-76d989ee-fd7a-4efb-872a-a53ca00d814f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:51.457160 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-76d989ee-fd7a-4efb-872a-a53ca00d814f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:51.594788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-76d989ee-fd7a-4efb-872a-a53ca00d814f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:51.603190 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-76d989ee-fd7a-4efb-872a-a53ca00d814f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.158963 Jul 12 03:54:51.603760 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 290/602] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:51 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:52.621470 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e4032d02-eb02-42f3-a6be-36b9d23c311f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:52.622033 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e4032d02-eb02-42f3-a6be-36b9d23c311f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:52.628430 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e4032d02-eb02-42f3-a6be-36b9d23c311f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:52.628879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e4032d02-eb02-42f3-a6be-36b9d23c311f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:52.629645 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e4032d02-eb02-42f3-a6be-36b9d23c311f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:52.630069 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e4032d02-eb02-42f3-a6be-36b9d23c311f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:52.772029 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e4032d02-eb02-42f3-a6be-36b9d23c311f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:52.780335 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e4032d02-eb02-42f3-a6be-36b9d23c311f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.163727 Jul 12 03:54:52.780903 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 313/603] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:52 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:53.797951 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-99fe0d6c-e559-42d3-a89c-100c05292d3b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:53.798524 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-99fe0d6c-e559-42d3-a89c-100c05292d3b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:53.805625 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-99fe0d6c-e559-42d3-a89c-100c05292d3b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:53.806072 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-99fe0d6c-e559-42d3-a89c-100c05292d3b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:53.806880 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-99fe0d6c-e559-42d3-a89c-100c05292d3b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:53.807288 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-99fe0d6c-e559-42d3-a89c-100c05292d3b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:53.943939 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-99fe0d6c-e559-42d3-a89c-100c05292d3b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:53.953304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-99fe0d6c-e559-42d3-a89c-100c05292d3b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1724 microversion: 2.1 time: 0.159323 Jul 12 03:54:53.953847 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 291/604] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:53 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:54.970590 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a66ee45e-8352-4871-b699-c3b1bac0f46d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:54.971216 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a66ee45e-8352-4871-b699-c3b1bac0f46d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:54.978627 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a66ee45e-8352-4871-b699-c3b1bac0f46d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:54.979083 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a66ee45e-8352-4871-b699-c3b1bac0f46d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:54.979846 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a66ee45e-8352-4871-b699-c3b1bac0f46d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:54.980317 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a66ee45e-8352-4871-b699-c3b1bac0f46d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:55.111067 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a66ee45e-8352-4871-b699-c3b1bac0f46d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:55.119679 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a66ee45e-8352-4871-b699-c3b1bac0f46d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1701 microversion: 2.1 time: 0.153088 Jul 12 03:54:55.120302 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 314/605] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:54 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:55.140402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6267d08f-a97b-4796-96af-9a8f4b3bea98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:54:55.147431 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6267d08f-a97b-4796-96af-9a8f4b3bea98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:55.147877 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6267d08f-a97b-4796-96af-9a8f4b3bea98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:55.173970 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6267d08f-a97b-4796-96af-9a8f4b3bea98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Going to try to start instance {{(pid=124435) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 03:54:55.234168 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6267d08f-a97b-4796-96af-9a8f4b3bea98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "POST /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/action" status: 202 len: 0 microversion: 2.1 time: 0.097483 Jul 12 03:54:55.234846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 292/606] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 03:54:55 2022] POST /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:54:55.243379 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-3476ed17-a33e-4442-a71a-ea6de9dd9cb5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:55.243996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-3476ed17-a33e-4442-a71a-ea6de9dd9cb5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:55.250549 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3476ed17-a33e-4442-a71a-ea6de9dd9cb5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:55.250998 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3476ed17-a33e-4442-a71a-ea6de9dd9cb5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:55.251766 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3476ed17-a33e-4442-a71a-ea6de9dd9cb5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:55.252233 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3476ed17-a33e-4442-a71a-ea6de9dd9cb5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:55.393401 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-3476ed17-a33e-4442-a71a-ea6de9dd9cb5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:55.397455 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:54:55.402267 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-3476ed17-a33e-4442-a71a-ea6de9dd9cb5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1710 microversion: 2.1 time: 0.163131 Jul 12 03:54:55.402859 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 315/607] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:55 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:56.420659 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a6ba7883-c71a-41d2-8e3e-17259d05d647 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:56.421387 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a6ba7883-c71a-41d2-8e3e-17259d05d647 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:56.427840 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a6ba7883-c71a-41d2-8e3e-17259d05d647 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:56.428330 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a6ba7883-c71a-41d2-8e3e-17259d05d647 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:56.429120 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a6ba7883-c71a-41d2-8e3e-17259d05d647 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:56.429553 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a6ba7883-c71a-41d2-8e3e-17259d05d647 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:56.565249 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a6ba7883-c71a-41d2-8e3e-17259d05d647 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:56.575294 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a6ba7883-c71a-41d2-8e3e-17259d05d647 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1710 microversion: 2.1 time: 0.159220 Jul 12 03:54:56.586801 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 293/608] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:56 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:57.597078 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c4895646-1d44-40db-b8b3-e523e37ebf08 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:57.598120 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c4895646-1d44-40db-b8b3-e523e37ebf08 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:57.610051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4895646-1d44-40db-b8b3-e523e37ebf08 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:57.610837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4895646-1d44-40db-b8b3-e523e37ebf08 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:57.612098 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4895646-1d44-40db-b8b3-e523e37ebf08 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:57.612827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4895646-1d44-40db-b8b3-e523e37ebf08 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:57.751903 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c4895646-1d44-40db-b8b3-e523e37ebf08 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:57.760338 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c4895646-1d44-40db-b8b3-e523e37ebf08 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1714 microversion: 2.1 time: 0.169586 Jul 12 03:54:57.761063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 316/609] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:57 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1714 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:54:58.804603 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-55091211-38a6-44d8-8839-b07d836be8d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:54:58.805587 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-55091211-38a6-44d8-8839-b07d836be8d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:58.814328 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-55091211-38a6-44d8-8839-b07d836be8d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:58.814863 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-55091211-38a6-44d8-8839-b07d836be8d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:58.815734 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-55091211-38a6-44d8-8839-b07d836be8d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:58.816315 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-55091211-38a6-44d8-8839-b07d836be8d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:58.839297 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.objects.instance [None req-55091211-38a6-44d8-8839-b07d836be8d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lazy-loading 'flavor' on Instance uuid 82e3bc04-35b0-412b-b8d6-65165bc79e60 {{(pid=124435) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:54:58.966657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-55091211-38a6-44d8-8839-b07d836be8d1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "POST /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/action" status: 200 len: 32 microversion: 2.1 time: 0.166094 Jul 12 03:54:58.967347 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 294/610] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 03:54:58 2022] POST /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 03:54:58.977161 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ca3f8722-6bc4-4530-b97e-b1fdec550295 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:54:58.978442 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ca3f8722-6bc4-4530-b97e-b1fdec550295 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:54:58.980990 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:54:58.987782 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ca3f8722-6bc4-4530-b97e-b1fdec550295 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:58.988467 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ca3f8722-6bc4-4530-b97e-b1fdec550295 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:58.989456 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ca3f8722-6bc4-4530-b97e-b1fdec550295 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:54:58.989907 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ca3f8722-6bc4-4530-b97e-b1fdec550295 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:54:59.217300 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ca3f8722-6bc4-4530-b97e-b1fdec550295 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:54:59.225388 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ca3f8722-6bc4-4530-b97e-b1fdec550295 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.252728 Jul 12 03:54:59.226261 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 317/611] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:54:58 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:00.243621 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-363370ea-adda-4904-91a4-1fd3d9eb626c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:00.244348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-363370ea-adda-4904-91a4-1fd3d9eb626c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:00.251104 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-363370ea-adda-4904-91a4-1fd3d9eb626c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:00.251552 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-363370ea-adda-4904-91a4-1fd3d9eb626c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:00.252338 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-363370ea-adda-4904-91a4-1fd3d9eb626c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:00.252767 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-363370ea-adda-4904-91a4-1fd3d9eb626c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:00.384413 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-363370ea-adda-4904-91a4-1fd3d9eb626c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:00.392549 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-363370ea-adda-4904-91a4-1fd3d9eb626c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.153643 Jul 12 03:55:00.396226 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 295/612] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:00 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:01.410403 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e124194a-9e3f-416c-a746-11e54b93a0a2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:01.411017 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e124194a-9e3f-416c-a746-11e54b93a0a2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:01.418065 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e124194a-9e3f-416c-a746-11e54b93a0a2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:01.418542 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e124194a-9e3f-416c-a746-11e54b93a0a2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:01.419446 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e124194a-9e3f-416c-a746-11e54b93a0a2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:01.419743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e124194a-9e3f-416c-a746-11e54b93a0a2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:01.568170 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e124194a-9e3f-416c-a746-11e54b93a0a2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:01.577073 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e124194a-9e3f-416c-a746-11e54b93a0a2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.170712 Jul 12 03:55:01.577767 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 318/613] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:01 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:02.596166 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-44a5d187-9322-4f53-b1a0-e1a0abc910c6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:02.597555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-44a5d187-9322-4f53-b1a0-e1a0abc910c6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:02.606090 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-44a5d187-9322-4f53-b1a0-e1a0abc910c6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:02.607093 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-44a5d187-9322-4f53-b1a0-e1a0abc910c6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:02.607962 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-44a5d187-9322-4f53-b1a0-e1a0abc910c6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:02.608504 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-44a5d187-9322-4f53-b1a0-e1a0abc910c6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:02.830980 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-44a5d187-9322-4f53-b1a0-e1a0abc910c6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:02.841643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-44a5d187-9322-4f53-b1a0-e1a0abc910c6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.250991 Jul 12 03:55:02.842521 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 296/614] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:02 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:03.859288 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-581a8823-253e-435d-a01c-e86a7ab55864 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:03.860207 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-581a8823-253e-435d-a01c-e86a7ab55864 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:03.868107 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-581a8823-253e-435d-a01c-e86a7ab55864 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:03.868930 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-581a8823-253e-435d-a01c-e86a7ab55864 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:03.870008 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-581a8823-253e-435d-a01c-e86a7ab55864 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:03.870692 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-581a8823-253e-435d-a01c-e86a7ab55864 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:04.031054 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-581a8823-253e-435d-a01c-e86a7ab55864 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:04.042371 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-581a8823-253e-435d-a01c-e86a7ab55864 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.187304 Jul 12 03:55:04.043421 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 319/615] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:03 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:05.058686 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c90cf7ec-be44-4db7-851b-9d192fe4418b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:05.059292 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c90cf7ec-be44-4db7-851b-9d192fe4418b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:05.065945 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=32 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:05.073381 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c90cf7ec-be44-4db7-851b-9d192fe4418b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:05.073834 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c90cf7ec-be44-4db7-851b-9d192fe4418b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:05.074618 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c90cf7ec-be44-4db7-851b-9d192fe4418b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:05.075053 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c90cf7ec-be44-4db7-851b-9d192fe4418b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:05.219036 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c90cf7ec-be44-4db7-851b-9d192fe4418b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:05.227939 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c90cf7ec-be44-4db7-851b-9d192fe4418b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.173117 Jul 12 03:55:05.228579 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 297/616] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:05 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:06.245771 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d27d0ee0-ad2e-4fa4-9fcd-ec3bb01b5a76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:06.246989 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d27d0ee0-ad2e-4fa4-9fcd-ec3bb01b5a76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:06.255478 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d27d0ee0-ad2e-4fa4-9fcd-ec3bb01b5a76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:06.256214 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d27d0ee0-ad2e-4fa4-9fcd-ec3bb01b5a76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:06.257151 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d27d0ee0-ad2e-4fa4-9fcd-ec3bb01b5a76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:06.257747 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d27d0ee0-ad2e-4fa4-9fcd-ec3bb01b5a76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:06.529675 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d27d0ee0-ad2e-4fa4-9fcd-ec3bb01b5a76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:06.542739 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d27d0ee0-ad2e-4fa4-9fcd-ec3bb01b5a76 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.301151 Jul 12 03:55:06.543320 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 320/617] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:06 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:07.562070 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bccf973a-472d-4ac9-8164-c051f28c7417 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:07.562845 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-bccf973a-472d-4ac9-8164-c051f28c7417 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:07.586658 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bccf973a-472d-4ac9-8164-c051f28c7417 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:07.587651 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bccf973a-472d-4ac9-8164-c051f28c7417 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:07.597649 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bccf973a-472d-4ac9-8164-c051f28c7417 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:07.598128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bccf973a-472d-4ac9-8164-c051f28c7417 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:07.648963 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:07.869877 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bccf973a-472d-4ac9-8164-c051f28c7417 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:07.894451 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bccf973a-472d-4ac9-8164-c051f28c7417 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.330386 Jul 12 03:55:07.895426 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 298/618] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:07 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:08.912690 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-803bc630-a251-4908-b507-4230bd8fe229 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:08.913883 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-803bc630-a251-4908-b507-4230bd8fe229 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:08.920711 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-803bc630-a251-4908-b507-4230bd8fe229 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:08.921172 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-803bc630-a251-4908-b507-4230bd8fe229 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:08.921967 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-803bc630-a251-4908-b507-4230bd8fe229 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:08.922613 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-803bc630-a251-4908-b507-4230bd8fe229 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:09.098039 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-803bc630-a251-4908-b507-4230bd8fe229 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:09.109166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-803bc630-a251-4908-b507-4230bd8fe229 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.200785 Jul 12 03:55:09.110120 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 321/619] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:08 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:10.129069 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8c344a72-a638-4c79-9a92-ca72fcc66e0b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:10.130381 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8c344a72-a638-4c79-9a92-ca72fcc66e0b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:10.139530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8c344a72-a638-4c79-9a92-ca72fcc66e0b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:10.140523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8c344a72-a638-4c79-9a92-ca72fcc66e0b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:10.141567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8c344a72-a638-4c79-9a92-ca72fcc66e0b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:10.142079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8c344a72-a638-4c79-9a92-ca72fcc66e0b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:10.289509 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8c344a72-a638-4c79-9a92-ca72fcc66e0b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:10.303468 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8c344a72-a638-4c79-9a92-ca72fcc66e0b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.180332 Jul 12 03:55:10.304201 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 299/620] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:10 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:11.323675 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-43127c68-0bb9-41fb-a9eb-710458c7f1f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:11.324323 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-43127c68-0bb9-41fb-a9eb-710458c7f1f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:11.331119 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-43127c68-0bb9-41fb-a9eb-710458c7f1f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:11.331753 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-43127c68-0bb9-41fb-a9eb-710458c7f1f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:11.332774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-43127c68-0bb9-41fb-a9eb-710458c7f1f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:11.333361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-43127c68-0bb9-41fb-a9eb-710458c7f1f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:11.501888 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-43127c68-0bb9-41fb-a9eb-710458c7f1f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:11.517388 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-43127c68-0bb9-41fb-a9eb-710458c7f1f8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.200030 Jul 12 03:55:11.518080 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 322/621] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:11 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:12.534854 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-75283dbc-bf4c-4140-8ce3-e7b7f43ea163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:12.535436 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-75283dbc-bf4c-4140-8ce3-e7b7f43ea163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:12.543523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-75283dbc-bf4c-4140-8ce3-e7b7f43ea163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:12.544531 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-75283dbc-bf4c-4140-8ce3-e7b7f43ea163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:12.545540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-75283dbc-bf4c-4140-8ce3-e7b7f43ea163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:12.546147 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-75283dbc-bf4c-4140-8ce3-e7b7f43ea163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:12.695660 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-75283dbc-bf4c-4140-8ce3-e7b7f43ea163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:12.705011 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-75283dbc-bf4c-4140-8ce3-e7b7f43ea163 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.174068 Jul 12 03:55:12.706501 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 300/622] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:12 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:13.728279 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a79c97e5-7639-4a21-9760-5db24068aabf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:13.729891 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a79c97e5-7639-4a21-9760-5db24068aabf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:13.751135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a79c97e5-7639-4a21-9760-5db24068aabf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:13.751762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a79c97e5-7639-4a21-9760-5db24068aabf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:13.753279 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a79c97e5-7639-4a21-9760-5db24068aabf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:13.753882 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a79c97e5-7639-4a21-9760-5db24068aabf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:13.964303 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a79c97e5-7639-4a21-9760-5db24068aabf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:13.974718 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a79c97e5-7639-4a21-9760-5db24068aabf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.254714 Jul 12 03:55:13.977886 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 323/623] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:13 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:14.994756 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6827f35d-490a-49fe-bf44-8b27c0588fc0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:14.996678 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6827f35d-490a-49fe-bf44-8b27c0588fc0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:15.003495 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6827f35d-490a-49fe-bf44-8b27c0588fc0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:15.004182 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6827f35d-490a-49fe-bf44-8b27c0588fc0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:15.005287 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6827f35d-490a-49fe-bf44-8b27c0588fc0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:15.005870 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6827f35d-490a-49fe-bf44-8b27c0588fc0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:15.155088 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6827f35d-490a-49fe-bf44-8b27c0588fc0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:15.164464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6827f35d-490a-49fe-bf44-8b27c0588fc0 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.173319 Jul 12 03:55:15.165325 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 301/624] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:14 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:16.182687 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cf6cd149-59c3-4fcc-ba91-4881ca6caa34 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:16.183247 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-cf6cd149-59c3-4fcc-ba91-4881ca6caa34 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:16.197805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cf6cd149-59c3-4fcc-ba91-4881ca6caa34 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:16.198355 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cf6cd149-59c3-4fcc-ba91-4881ca6caa34 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:16.199362 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cf6cd149-59c3-4fcc-ba91-4881ca6caa34 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:16.199839 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cf6cd149-59c3-4fcc-ba91-4881ca6caa34 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:16.357284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cf6cd149-59c3-4fcc-ba91-4881ca6caa34 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:16.367742 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cf6cd149-59c3-4fcc-ba91-4881ca6caa34 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.189401 Jul 12 03:55:16.368707 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 324/625] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:16 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:17.385476 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bbb920ef-2329-49b5-b3b7-c01c581a782d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:17.386092 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-bbb920ef-2329-49b5-b3b7-c01c581a782d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:17.393433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bbb920ef-2329-49b5-b3b7-c01c581a782d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:17.394476 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bbb920ef-2329-49b5-b3b7-c01c581a782d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:17.395322 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bbb920ef-2329-49b5-b3b7-c01c581a782d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:17.395765 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bbb920ef-2329-49b5-b3b7-c01c581a782d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:17.536507 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bbb920ef-2329-49b5-b3b7-c01c581a782d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:17.545863 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bbb920ef-2329-49b5-b3b7-c01c581a782d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.164290 Jul 12 03:55:17.546445 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 302/626] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:17 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:18.563638 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cee49b1a-c409-41af-acaf-3b82f6113be9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:18.564476 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-cee49b1a-c409-41af-acaf-3b82f6113be9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:18.572686 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cee49b1a-c409-41af-acaf-3b82f6113be9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:18.573137 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cee49b1a-c409-41af-acaf-3b82f6113be9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:18.573970 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cee49b1a-c409-41af-acaf-3b82f6113be9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:18.574403 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cee49b1a-c409-41af-acaf-3b82f6113be9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:18.730645 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cee49b1a-c409-41af-acaf-3b82f6113be9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:18.741946 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cee49b1a-c409-41af-acaf-3b82f6113be9 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.182295 Jul 12 03:55:18.742954 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 325/627] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:18 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:19.228356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bc98e559-13de-4e07-8cd3-11c45a417c85 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Action: 'create', calling method: .version_select at 0x7fd7fa69caf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-381408628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEU5ocuvcjmXXvAshea2UG1zxLOQ/4F83904HjHj9X9Cp5gvYIFRmJztEjkkl3AMuP7rowN4KSi1kfJRQEGYbEJ69b9UKI5565NFKglJqh5pdrJwbwaVpsxthGDf/5e2ig=="}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:19.244344 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-bc98e559-13de-4e07-8cd3-11c45a417c85 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Getting quotas for project b38d912121c64d5e887dc21e354b3cfd. Resources: {'key_pairs'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:55:19.248770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-bc98e559-13de-4e07-8cd3-11c45a417c85 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Getting quotas for user 8701284390d345eabc027e05f9ac262b and project b38d912121c64d5e887dc21e354b3cfd. Resources: {'key_pairs'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:55:19.279572 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bc98e559-13de-4e07-8cd3-11c45a417c85 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054755 Jul 12 03:55:19.280377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 303/628] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 03:55:19 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:55:19.332828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1965522367", "imageRef": "a7981728-d676-40c6-b357-0055d73637de", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-381408628", "networks": [{"uuid": "15e20b49-c0f2-4a45-8fc9-0e2c8ae40cee"}]}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:19.383303 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.network.neutron [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] validate_networks() for [('15e20b49-c0f2-4a45-8fc9-0e2c8ae40cee', None, None, None, None, None)] {{(pid=124434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:55:19.760097 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-30f67cdd-a7eb-4394-9362-2a368ad5e159 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:19.761080 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-30f67cdd-a7eb-4394-9362-2a368ad5e159 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:19.767670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30f67cdd-a7eb-4394-9362-2a368ad5e159 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:19.768265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30f67cdd-a7eb-4394-9362-2a368ad5e159 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:19.769606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30f67cdd-a7eb-4394-9362-2a368ad5e159 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:19.770279 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30f67cdd-a7eb-4394-9362-2a368ad5e159 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:19.849430 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Flavor limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:55:19.849899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Image limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:55:19.850422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Flavor pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:55:19.851118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Image pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:55:19.851838 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:55:19.862503 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:19.862959 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:19.863943 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:19.864456 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:19.882351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Getting quotas for project b38d912121c64d5e887dc21e354b3cfd. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:55:19.886532 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Getting quotas for user 8701284390d345eabc027e05f9ac262b and project b38d912121c64d5e887dc21e354b3cfd. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:55:19.898617 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Going to run 1 instances... {{(pid=124434) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:55:19.900970 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7981728-d676-40c6-b357-0055d73637de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:55:19.950688 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e2d9e785-ff1f-46fc-b3f6-4dca232ea691 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621790 Jul 12 03:55:19.951351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 326/629] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:55:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 03:55:19.966749 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-190117fc-1089-4815-b0d5-1a1e51e83e8f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:19.967433 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-190117fc-1089-4815-b0d5-1a1e51e83e8f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:19.973785 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-30f67cdd-a7eb-4394-9362-2a368ad5e159 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:19.998817 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-30f67cdd-a7eb-4394-9362-2a368ad5e159 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.242808 Jul 12 03:55:19.999712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 304/630] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:19 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:20.031025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-190117fc-1089-4815-b0d5-1a1e51e83e8f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:20.038192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-190117fc-1089-4815-b0d5-1a1e51e83e8f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1258 microversion: 2.1 time: 0.080485 Jul 12 03:55:20.038752 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 327/631] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:19 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:21.016602 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0321373e-3d74-4199-a62e-1fa6f7fb43c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:21.017217 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0321373e-3d74-4199-a62e-1fa6f7fb43c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:21.024673 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0321373e-3d74-4199-a62e-1fa6f7fb43c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:21.025257 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0321373e-3d74-4199-a62e-1fa6f7fb43c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:21.026025 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0321373e-3d74-4199-a62e-1fa6f7fb43c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:21.026477 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0321373e-3d74-4199-a62e-1fa6f7fb43c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:21.054787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-860a613b-2e22-43c8-98a3-78cc3814900c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:21.055397 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-860a613b-2e22-43c8-98a3-78cc3814900c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:21.062530 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-860a613b-2e22-43c8-98a3-78cc3814900c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:21.063059 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-860a613b-2e22-43c8-98a3-78cc3814900c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:21.063925 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-860a613b-2e22-43c8-98a3-78cc3814900c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:21.064398 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-860a613b-2e22-43c8-98a3-78cc3814900c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:21.129267 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-860a613b-2e22-43c8-98a3-78cc3814900c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:21.137215 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-860a613b-2e22-43c8-98a3-78cc3814900c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1262 microversion: 2.1 time: 0.086229 Jul 12 03:55:21.137787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 328/632] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:21 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:55:21.166785 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0321373e-3d74-4199-a62e-1fa6f7fb43c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:21.175032 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0321373e-3d74-4199-a62e-1fa6f7fb43c7 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.162373 Jul 12 03:55:21.175589 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 305/633] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:21 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:22.154976 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c77354b3-960d-45ac-8eb4-f741f95a93f3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:22.155527 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c77354b3-960d-45ac-8eb4-f741f95a93f3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:22.162307 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c77354b3-960d-45ac-8eb4-f741f95a93f3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:22.162765 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c77354b3-960d-45ac-8eb4-f741f95a93f3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:22.163527 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c77354b3-960d-45ac-8eb4-f741f95a93f3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:22.163962 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c77354b3-960d-45ac-8eb4-f741f95a93f3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:22.192328 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d44be1e5-a728-4e02-84e4-5b79d68ac807 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:22.192881 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d44be1e5-a728-4e02-84e4-5b79d68ac807 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:22.199734 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d44be1e5-a728-4e02-84e4-5b79d68ac807 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:22.200185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d44be1e5-a728-4e02-84e4-5b79d68ac807 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:22.200939 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d44be1e5-a728-4e02-84e4-5b79d68ac807 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:22.201367 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d44be1e5-a728-4e02-84e4-5b79d68ac807 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:22.229143 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c77354b3-960d-45ac-8eb4-f741f95a93f3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:22.236779 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c77354b3-960d-45ac-8eb4-f741f95a93f3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1310 microversion: 2.1 time: 0.086044 Jul 12 03:55:22.237386 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 329/634] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:22 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:22.327958 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d44be1e5-a728-4e02-84e4-5b79d68ac807 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:22.336033 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d44be1e5-a728-4e02-84e4-5b79d68ac807 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.147671 Jul 12 03:55:22.336635 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 306/635] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:22 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:23.255052 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6ac7ae11-430b-4a6c-b4f4-62323eb94232 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:23.255625 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-6ac7ae11-430b-4a6c-b4f4-62323eb94232 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:23.262663 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6ac7ae11-430b-4a6c-b4f4-62323eb94232 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:23.263132 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6ac7ae11-430b-4a6c-b4f4-62323eb94232 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:23.263927 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6ac7ae11-430b-4a6c-b4f4-62323eb94232 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:23.264391 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6ac7ae11-430b-4a6c-b4f4-62323eb94232 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:23.334043 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-6ac7ae11-430b-4a6c-b4f4-62323eb94232 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:23.342191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-6ac7ae11-430b-4a6c-b4f4-62323eb94232 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1310 microversion: 2.1 time: 0.091876 Jul 12 03:55:23.343029 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 330/636] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:23 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:23.354378 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d70f8d23-5f0c-4330-91f1-48bb1dd6db10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:23.354986 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d70f8d23-5f0c-4330-91f1-48bb1dd6db10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:23.361715 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d70f8d23-5f0c-4330-91f1-48bb1dd6db10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:23.362158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d70f8d23-5f0c-4330-91f1-48bb1dd6db10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:23.362917 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d70f8d23-5f0c-4330-91f1-48bb1dd6db10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:23.363349 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d70f8d23-5f0c-4330-91f1-48bb1dd6db10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:23.801364 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d70f8d23-5f0c-4330-91f1-48bb1dd6db10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:23.810015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d70f8d23-5f0c-4330-91f1-48bb1dd6db10 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1735 microversion: 2.1 time: 0.459677 Jul 12 03:55:23.810559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 307/637] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:23 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1735 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:24.362022 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-910c3df8-6f28-46e8-be45-53dbf1a1e949 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:24.363183 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-910c3df8-6f28-46e8-be45-53dbf1a1e949 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:24.370393 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-910c3df8-6f28-46e8-be45-53dbf1a1e949 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:24.371042 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-910c3df8-6f28-46e8-be45-53dbf1a1e949 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:24.371947 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-910c3df8-6f28-46e8-be45-53dbf1a1e949 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:24.372479 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-910c3df8-6f28-46e8-be45-53dbf1a1e949 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:24.441581 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-910c3df8-6f28-46e8-be45-53dbf1a1e949 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:24.451525 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-910c3df8-6f28-46e8-be45-53dbf1a1e949 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1316 microversion: 2.1 time: 0.093443 Jul 12 03:55:24.453143 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 331/638] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:24 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1316 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:24.827341 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9d1eb07c-15df-40c0-8c4e-890062d6b56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:24.828030 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9d1eb07c-15df-40c0-8c4e-890062d6b56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:24.835000 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9d1eb07c-15df-40c0-8c4e-890062d6b56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:24.835368 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9d1eb07c-15df-40c0-8c4e-890062d6b56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:24.836175 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9d1eb07c-15df-40c0-8c4e-890062d6b56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:24.836605 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9d1eb07c-15df-40c0-8c4e-890062d6b56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:25.048687 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9d1eb07c-15df-40c0-8c4e-890062d6b56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:25.057309 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9d1eb07c-15df-40c0-8c4e-890062d6b56e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1715 microversion: 2.1 time: 0.234209 Jul 12 03:55:25.058233 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 308/639] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:24 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1715 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:25.183913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7149ca6c-269e-4b2a-ac0f-aca4c3823c9f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:25.184437 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7149ca6c-269e-4b2a-ac0f-aca4c3823c9f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:25.190437 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7149ca6c-269e-4b2a-ac0f-aca4c3823c9f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:25.190888 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7149ca6c-269e-4b2a-ac0f-aca4c3823c9f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:25.191644 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7149ca6c-269e-4b2a-ac0f-aca4c3823c9f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:25.192096 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7149ca6c-269e-4b2a-ac0f-aca4c3823c9f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:25.287988 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-7149ca6c-269e-4b2a-ac0f-aca4c3823c9f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] HTTP exception thrown: Cannot 'detach_volume' instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 while it is in vm_state rescued Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7149ca6c-269e-4b2a-ac0f-aca4c3823c9f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Request method failure captured: Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: DELETE /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-volume_attachments/0875ffcb-cea6-42fa-9d27-e78ae883f412 HTTP/1.1 Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO85KuFNBV6-7fhbKmf1HpN6NpFGL5F9bcT48Xy246CyrY1X-tZ6u1_GDiVEEcEOXK-36PJ2uqiZHJaN-K6sZMfqj7MllOAmWZRTHd3ToaqY0XJtpityteYLeRZ64xutpJXSWrWjQe5b6KmzxNtSsfX6_4rSQHrXOiL1YcZZVJ6djNA Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: fd03cff94a1842d8811deafa0dce10f9 Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 03:55:25.289649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 03:55:25.291294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd03cff94a1842d8811deafa0dce10f9"}]}] Jul 12 03:55:25.291294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:55:25.291294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: fd03cff94a1842d8811deafa0dce10f9 Jul 12 03:55:25.291294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:55:25.291294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-ServerRescueNegativeTestJSON-1509525019-project Jul 12 03:55:25.291294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 03:55:25.291294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 03:55:25.291294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 4ac2825db0c649cab6dcc2e27fbaf80d Jul 12 03:55:25.291294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1509525019-project Jul 12 03:55:25.291294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 03:55:25.291294 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Cannot 'detach_volume' instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 while it is in vm_state rescued Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'server_id': '82e3bc04-35b0-412b-b8d6-65165bc79e60', 'id': '0875ffcb-cea6-42fa-9d27-e78ae883f412'} Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:55:25.292192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 while it is in vm_state rescued Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 while it is in vm_state rescued Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:55:25.293650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7149ca6c-269e-4b2a-ac0f-aca4c3823c9f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Returning 409 to user: Cannot 'detach_volume' instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 while it is in vm_state rescued {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:55:25.294871 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7149ca6c-269e-4b2a-ac0f-aca4c3823c9f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "DELETE /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-volume_attachments/0875ffcb-cea6-42fa-9d27-e78ae883f412" status: 409 len: 152 microversion: 2.1 time: 0.111282 Jul 12 03:55:25.294871 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 332/640] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 03:55:25 2022] DELETE /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-volume_attachments/0875ffcb-cea6-42fa-9d27-e78ae883f412 => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 03:55:25.300376 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e1746ce8-6800-4bb1-849f-9a8b11c59bec tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:25.300898 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e1746ce8-6800-4bb1-849f-9a8b11c59bec tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:25.307562 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e1746ce8-6800-4bb1-849f-9a8b11c59bec tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:25.307995 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e1746ce8-6800-4bb1-849f-9a8b11c59bec tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:25.308797 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e1746ce8-6800-4bb1-849f-9a8b11c59bec tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:25.309223 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e1746ce8-6800-4bb1-849f-9a8b11c59bec tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:25.383170 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e1746ce8-6800-4bb1-849f-9a8b11c59bec tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "POST /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/action" status: 202 len: 0 microversion: 2.1 time: 0.086459 Jul 12 03:55:25.383880 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 309/641] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 03:55:25 2022] POST /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:55:25.392192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6a0a0116-7e9a-45be-b000-fdf7d67642c2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:25.392928 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-6a0a0116-7e9a-45be-b000-fdf7d67642c2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:25.401583 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6a0a0116-7e9a-45be-b000-fdf7d67642c2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:25.402078 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6a0a0116-7e9a-45be-b000-fdf7d67642c2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:25.402906 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6a0a0116-7e9a-45be-b000-fdf7d67642c2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:25.403358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6a0a0116-7e9a-45be-b000-fdf7d67642c2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:25.469723 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0e8b2bc3-ef5c-4333-b02f-0435d650f662 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:25.470447 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0e8b2bc3-ef5c-4333-b02f-0435d650f662 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:25.478936 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0e8b2bc3-ef5c-4333-b02f-0435d650f662 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:25.479538 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0e8b2bc3-ef5c-4333-b02f-0435d650f662 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:25.480437 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0e8b2bc3-ef5c-4333-b02f-0435d650f662 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:25.480948 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0e8b2bc3-ef5c-4333-b02f-0435d650f662 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:25.565488 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-6a0a0116-7e9a-45be-b000-fdf7d67642c2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:25.575948 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-6a0a0116-7e9a-45be-b000-fdf7d67642c2 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.187762 Jul 12 03:55:25.577130 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 333/642] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:25 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:25.624758 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0e8b2bc3-ef5c-4333-b02f-0435d650f662 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:25.632478 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0e8b2bc3-ef5c-4333-b02f-0435d650f662 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.167532 Jul 12 03:55:25.633050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 310/643] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:25 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:55:26.597998 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1c27a4cf-8277-4b11-9521-b7db0fd3a25f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:26.600362 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1c27a4cf-8277-4b11-9521-b7db0fd3a25f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:26.609185 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1c27a4cf-8277-4b11-9521-b7db0fd3a25f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:26.609635 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1c27a4cf-8277-4b11-9521-b7db0fd3a25f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:26.610398 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1c27a4cf-8277-4b11-9521-b7db0fd3a25f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:26.610839 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1c27a4cf-8277-4b11-9521-b7db0fd3a25f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:26.614935 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:26.649859 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ff630f13-9e9f-4a20-aca6-2b0426782e40 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:26.650801 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ff630f13-9e9f-4a20-aca6-2b0426782e40 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:26.658090 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ff630f13-9e9f-4a20-aca6-2b0426782e40 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:26.658548 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ff630f13-9e9f-4a20-aca6-2b0426782e40 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:26.659321 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ff630f13-9e9f-4a20-aca6-2b0426782e40 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:26.659754 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ff630f13-9e9f-4a20-aca6-2b0426782e40 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:26.759912 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1c27a4cf-8277-4b11-9521-b7db0fd3a25f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:26.768655 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1c27a4cf-8277-4b11-9521-b7db0fd3a25f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.177348 Jul 12 03:55:26.769281 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 334/644] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:26 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:26.801153 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ff630f13-9e9f-4a20-aca6-2b0426782e40 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:26.808722 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ff630f13-9e9f-4a20-aca6-2b0426782e40 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.163276 Jul 12 03:55:26.809296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 311/645] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:26 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:27.787620 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2df28f0c-c28b-4b12-ab27-4d3b6d350a2f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:27.789201 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2df28f0c-c28b-4b12-ab27-4d3b6d350a2f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:27.797292 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2df28f0c-c28b-4b12-ab27-4d3b6d350a2f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:27.798375 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2df28f0c-c28b-4b12-ab27-4d3b6d350a2f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:27.799478 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2df28f0c-c28b-4b12-ab27-4d3b6d350a2f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:27.800139 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2df28f0c-c28b-4b12-ab27-4d3b6d350a2f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:27.824810 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-322699a3-b20d-4600-b1e2-4f7849d605e3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:27.825406 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-322699a3-b20d-4600-b1e2-4f7849d605e3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:27.831872 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-322699a3-b20d-4600-b1e2-4f7849d605e3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:27.832364 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-322699a3-b20d-4600-b1e2-4f7849d605e3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:27.833132 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-322699a3-b20d-4600-b1e2-4f7849d605e3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:27.833552 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-322699a3-b20d-4600-b1e2-4f7849d605e3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:27.934230 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-2df28f0c-c28b-4b12-ab27-4d3b6d350a2f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:27.950370 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2df28f0c-c28b-4b12-ab27-4d3b6d350a2f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.167320 Jul 12 03:55:27.951741 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 335/646] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:27 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:27.984330 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-322699a3-b20d-4600-b1e2-4f7849d605e3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:27.991770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-322699a3-b20d-4600-b1e2-4f7849d605e3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.170966 Jul 12 03:55:27.992365 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 312/647] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:27 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:55:28.969499 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-16b326b8-65e3-491b-9634-c1850fee6ac1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:28.970119 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-16b326b8-65e3-491b-9634-c1850fee6ac1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:28.977225 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-16b326b8-65e3-491b-9634-c1850fee6ac1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:28.977653 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-16b326b8-65e3-491b-9634-c1850fee6ac1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:28.978426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-16b326b8-65e3-491b-9634-c1850fee6ac1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:28.978869 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-16b326b8-65e3-491b-9634-c1850fee6ac1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:29.008886 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-43fd9824-45c4-4c8c-a258-0005d24854e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:29.010244 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-43fd9824-45c4-4c8c-a258-0005d24854e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:29.017532 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-43fd9824-45c4-4c8c-a258-0005d24854e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:29.018330 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-43fd9824-45c4-4c8c-a258-0005d24854e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:29.020343 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-43fd9824-45c4-4c8c-a258-0005d24854e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:29.020992 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-43fd9824-45c4-4c8c-a258-0005d24854e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:29.125284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-16b326b8-65e3-491b-9634-c1850fee6ac1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:29.133579 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-16b326b8-65e3-491b-9634-c1850fee6ac1 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.167970 Jul 12 03:55:29.134158 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 336/648] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:28 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:29.162032 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-43fd9824-45c4-4c8c-a258-0005d24854e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:29.171408 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-43fd9824-45c4-4c8c-a258-0005d24854e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.166158 Jul 12 03:55:29.172214 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 313/649] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:29 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:55:30.152977 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-baf114a8-909f-4926-9283-bfdea48d043e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:30.153687 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-baf114a8-909f-4926-9283-bfdea48d043e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:30.155848 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:30.157034 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=8 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:30.157674 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:30.164033 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-baf114a8-909f-4926-9283-bfdea48d043e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:30.164638 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-baf114a8-909f-4926-9283-bfdea48d043e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:30.165428 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-baf114a8-909f-4926-9283-bfdea48d043e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:30.165861 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-baf114a8-909f-4926-9283-bfdea48d043e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:30.188637 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1a5afe27-45c4-47c3-af0e-e0056a553dc9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:30.189255 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1a5afe27-45c4-47c3-af0e-e0056a553dc9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:30.191246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=4 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:30.197544 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1a5afe27-45c4-47c3-af0e-e0056a553dc9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:30.197994 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1a5afe27-45c4-47c3-af0e-e0056a553dc9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:30.198838 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1a5afe27-45c4-47c3-af0e-e0056a553dc9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:30.199284 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1a5afe27-45c4-47c3-af0e-e0056a553dc9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:30.312358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-baf114a8-909f-4926-9283-bfdea48d043e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:30.321601 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-baf114a8-909f-4926-9283-bfdea48d043e tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.173885 Jul 12 03:55:30.322767 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 337/650] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:30 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:30.338231 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1a5afe27-45c4-47c3-af0e-e0056a553dc9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:30.345768 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1a5afe27-45c4-47c3-af0e-e0056a553dc9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.161041 Jul 12 03:55:30.346340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 314/651] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:30 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:55:31.342793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5b874dc8-40f3-427c-a1b2-17c48da18815 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:31.343592 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5b874dc8-40f3-427c-a1b2-17c48da18815 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:31.352060 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5b874dc8-40f3-427c-a1b2-17c48da18815 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:31.352660 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5b874dc8-40f3-427c-a1b2-17c48da18815 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:31.353609 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5b874dc8-40f3-427c-a1b2-17c48da18815 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:31.354158 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5b874dc8-40f3-427c-a1b2-17c48da18815 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:31.364197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-de30a454-4ca9-4abe-830b-32eb1733e09f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:31.365026 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-de30a454-4ca9-4abe-830b-32eb1733e09f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:31.373412 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-de30a454-4ca9-4abe-830b-32eb1733e09f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:31.373852 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-de30a454-4ca9-4abe-830b-32eb1733e09f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:31.374640 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-de30a454-4ca9-4abe-830b-32eb1733e09f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:31.375070 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-de30a454-4ca9-4abe-830b-32eb1733e09f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:31.378061 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:31.517083 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-de30a454-4ca9-4abe-830b-32eb1733e09f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:31.518285 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5b874dc8-40f3-427c-a1b2-17c48da18815 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:31.525950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-de30a454-4ca9-4abe-830b-32eb1733e09f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.166730 Jul 12 03:55:31.527094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5b874dc8-40f3-427c-a1b2-17c48da18815 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.190381 Jul 12 03:55:31.527930 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 338/652] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:31 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:31.529812 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 315/653] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:31 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:32.544215 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-20199360-eee7-4031-accf-94270c97f0ad tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:32.544926 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c8debe8f-fc45-4604-968c-5e3ffbaaca56 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:32.545325 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c8debe8f-fc45-4604-968c-5e3ffbaaca56 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:32.546244 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-20199360-eee7-4031-accf-94270c97f0ad tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:32.553833 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-20199360-eee7-4031-accf-94270c97f0ad tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:32.554680 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-20199360-eee7-4031-accf-94270c97f0ad tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:32.555687 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-20199360-eee7-4031-accf-94270c97f0ad tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:32.556375 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-20199360-eee7-4031-accf-94270c97f0ad tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:32.560954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c8debe8f-fc45-4604-968c-5e3ffbaaca56 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:32.561407 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c8debe8f-fc45-4604-968c-5e3ffbaaca56 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:32.562190 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c8debe8f-fc45-4604-968c-5e3ffbaaca56 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:32.562631 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c8debe8f-fc45-4604-968c-5e3ffbaaca56 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:32.702220 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-20199360-eee7-4031-accf-94270c97f0ad tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:32.715527 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c8debe8f-fc45-4604-968c-5e3ffbaaca56 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:32.724607 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c8debe8f-fc45-4604-968c-5e3ffbaaca56 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.183896 Jul 12 03:55:32.725527 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 316/654] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:32 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:32.727251 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-20199360-eee7-4031-accf-94270c97f0ad tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.187032 Jul 12 03:55:32.729077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 339/655] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:32 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:33.749938 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-70755f37-f1cd-4210-8b1d-ea614b57ab0f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:33.750636 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c6b0ca4c-c57c-4baa-843f-eb4963939a31 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:33.751184 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c6b0ca4c-c57c-4baa-843f-eb4963939a31 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:33.752640 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-70755f37-f1cd-4210-8b1d-ea614b57ab0f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:33.761122 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-70755f37-f1cd-4210-8b1d-ea614b57ab0f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:33.761789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-70755f37-f1cd-4210-8b1d-ea614b57ab0f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:33.763235 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-70755f37-f1cd-4210-8b1d-ea614b57ab0f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:33.763356 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6b0ca4c-c57c-4baa-843f-eb4963939a31 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:33.763717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6b0ca4c-c57c-4baa-843f-eb4963939a31 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:33.763836 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-70755f37-f1cd-4210-8b1d-ea614b57ab0f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:33.764519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6b0ca4c-c57c-4baa-843f-eb4963939a31 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:33.764951 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6b0ca4c-c57c-4baa-843f-eb4963939a31 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:33.924609 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c6b0ca4c-c57c-4baa-843f-eb4963939a31 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:33.932479 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c6b0ca4c-c57c-4baa-843f-eb4963939a31 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.190794 Jul 12 03:55:33.933338 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 340/656] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:33 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:33.943835 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-70755f37-f1cd-4210-8b1d-ea614b57ab0f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:33.952120 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-70755f37-f1cd-4210-8b1d-ea614b57ab0f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.213507 Jul 12 03:55:33.952690 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 317/657] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:33 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:34.949862 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d0d44c25-f8e2-44ef-9e6e-1b6dca7ced3d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:34.950511 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d0d44c25-f8e2-44ef-9e6e-1b6dca7ced3d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:34.957701 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d0d44c25-f8e2-44ef-9e6e-1b6dca7ced3d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:34.958156 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d0d44c25-f8e2-44ef-9e6e-1b6dca7ced3d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:34.958944 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d0d44c25-f8e2-44ef-9e6e-1b6dca7ced3d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:34.959370 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d0d44c25-f8e2-44ef-9e6e-1b6dca7ced3d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:34.969742 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9fedd257-4ccc-4092-9a37-c39f31a5dedf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:34.970554 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9fedd257-4ccc-4092-9a37-c39f31a5dedf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:34.977879 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9fedd257-4ccc-4092-9a37-c39f31a5dedf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:34.978332 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9fedd257-4ccc-4092-9a37-c39f31a5dedf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:34.979097 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9fedd257-4ccc-4092-9a37-c39f31a5dedf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:34.979545 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9fedd257-4ccc-4092-9a37-c39f31a5dedf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:35.120558 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d0d44c25-f8e2-44ef-9e6e-1b6dca7ced3d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:35.136276 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d0d44c25-f8e2-44ef-9e6e-1b6dca7ced3d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.190207 Jul 12 03:55:35.136883 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 341/658] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:34 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:35.147326 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9fedd257-4ccc-4092-9a37-c39f31a5dedf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:35.155715 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9fedd257-4ccc-4092-9a37-c39f31a5dedf tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.190360 Jul 12 03:55:35.156250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 318/659] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:34 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:36.157878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f975b271-68c5-4c2a-9019-6c2d2ebf5996 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:36.158873 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f975b271-68c5-4c2a-9019-6c2d2ebf5996 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:36.169900 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f975b271-68c5-4c2a-9019-6c2d2ebf5996 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:36.170775 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f975b271-68c5-4c2a-9019-6c2d2ebf5996 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:36.171578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f975b271-68c5-4c2a-9019-6c2d2ebf5996 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:36.172036 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f975b271-68c5-4c2a-9019-6c2d2ebf5996 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:36.175062 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6dcd0726-e576-46ac-92e7-5b84ba7d651f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:36.175675 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6dcd0726-e576-46ac-92e7-5b84ba7d651f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:36.177640 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:36.183678 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6dcd0726-e576-46ac-92e7-5b84ba7d651f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:36.184149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6dcd0726-e576-46ac-92e7-5b84ba7d651f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:36.184909 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6dcd0726-e576-46ac-92e7-5b84ba7d651f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:36.185345 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6dcd0726-e576-46ac-92e7-5b84ba7d651f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:36.301122 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f975b271-68c5-4c2a-9019-6c2d2ebf5996 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:36.309074 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f975b271-68c5-4c2a-9019-6c2d2ebf5996 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.157780 Jul 12 03:55:36.309684 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 342/660] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:36 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:36.314915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6dcd0726-e576-46ac-92e7-5b84ba7d651f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:36.323523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6dcd0726-e576-46ac-92e7-5b84ba7d651f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.153396 Jul 12 03:55:36.324101 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 319/661] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:36 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:37.330329 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-517c33d3-8b0b-4614-af57-d4994ac87c05 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:37.331297 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-517c33d3-8b0b-4614-af57-d4994ac87c05 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:37.342264 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-517c33d3-8b0b-4614-af57-d4994ac87c05 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:37.342964 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-517c33d3-8b0b-4614-af57-d4994ac87c05 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:37.343720 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-517c33d3-8b0b-4614-af57-d4994ac87c05 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:37.343864 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e976b5cd-1e3b-432b-8d48-473a10100d38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:37.344319 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-517c33d3-8b0b-4614-af57-d4994ac87c05 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:37.344421 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e976b5cd-1e3b-432b-8d48-473a10100d38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:37.351197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e976b5cd-1e3b-432b-8d48-473a10100d38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:37.351634 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e976b5cd-1e3b-432b-8d48-473a10100d38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:37.352419 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e976b5cd-1e3b-432b-8d48-473a10100d38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:37.352846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e976b5cd-1e3b-432b-8d48-473a10100d38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:37.472717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-517c33d3-8b0b-4614-af57-d4994ac87c05 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:37.480051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-517c33d3-8b0b-4614-af57-d4994ac87c05 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.156321 Jul 12 03:55:37.480608 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 343/662] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:37 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:37.487974 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e976b5cd-1e3b-432b-8d48-473a10100d38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:37.496295 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e976b5cd-1e3b-432b-8d48-473a10100d38 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.158308 Jul 12 03:55:37.496855 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 320/663] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:37 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:38.406883 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-39d566bb-6e3e-4e3f-8f84-a20256acfde3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:38.407788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-39d566bb-6e3e-4e3f-8f84-a20256acfde3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:38.419281 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-39d566bb-6e3e-4e3f-8f84-a20256acfde3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:38.420070 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-39d566bb-6e3e-4e3f-8f84-a20256acfde3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:38.421218 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-39d566bb-6e3e-4e3f-8f84-a20256acfde3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:38.421652 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-39d566bb-6e3e-4e3f-8f84-a20256acfde3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:38.450537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-39d566bb-6e3e-4e3f-8f84-a20256acfde3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-volume_attachments/8869bebe-69dd-49a6-a8ab-d3cfb5417803" status: 200 len: 194 microversion: 2.20 time: 0.050599 Jul 12 03:55:38.451098 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 344/664] 10.222.0.20 () {60 vars in 1453 bytes} [Tue Jul 12 03:55:38 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-volume_attachments/8869bebe-69dd-49a6-a8ab-d3cfb5417803 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:55:38.497073 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b7e0335b-7843-48ce-b1b4-794204188eff tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:38.497801 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b7e0335b-7843-48ce-b1b4-794204188eff tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:38.504879 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b7e0335b-7843-48ce-b1b4-794204188eff tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:38.505385 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b7e0335b-7843-48ce-b1b4-794204188eff tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:38.506153 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b7e0335b-7843-48ce-b1b4-794204188eff tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:38.506586 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b7e0335b-7843-48ce-b1b4-794204188eff tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:38.513635 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4e123857-5366-4667-9ec7-334b6e2fb663 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:38.514231 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4e123857-5366-4667-9ec7-334b6e2fb663 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:38.521171 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4e123857-5366-4667-9ec7-334b6e2fb663 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:38.521627 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4e123857-5366-4667-9ec7-334b6e2fb663 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:38.522390 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4e123857-5366-4667-9ec7-334b6e2fb663 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:38.522826 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4e123857-5366-4667-9ec7-334b6e2fb663 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:38.636123 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b7e0335b-7843-48ce-b1b4-794204188eff tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:38.643691 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b7e0335b-7843-48ce-b1b4-794204188eff tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.150484 Jul 12 03:55:38.644318 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 321/665] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:38 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:38.649325 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-06ad2914-a2ca-4c35-950a-05509437e96c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:38.649844 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-06ad2914-a2ca-4c35-950a-05509437e96c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:38.655753 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4e123857-5366-4667-9ec7-334b6e2fb663 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:38.655948 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-06ad2914-a2ca-4c35-950a-05509437e96c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:38.656357 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-06ad2914-a2ca-4c35-950a-05509437e96c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:38.657188 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-06ad2914-a2ca-4c35-950a-05509437e96c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:38.657560 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-06ad2914-a2ca-4c35-950a-05509437e96c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:38.663637 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4e123857-5366-4667-9ec7-334b6e2fb663 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.154002 Jul 12 03:55:38.664457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 345/666] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:38 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:38.783864 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.objects.instance [None req-06ad2914-a2ca-4c35-950a-05509437e96c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lazy-loading 'services' on Instance uuid ae771f5b-03de-46db-82fc-cd94d731405a {{(pid=124435) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:55:38.900325 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-06ad2914-a2ca-4c35-950a-05509437e96c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-volume_attachments/8869bebe-69dd-49a6-a8ab-d3cfb5417803" status: 202 len: 0 microversion: 2.20 time: 0.254300 Jul 12 03:55:38.901175 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 322/667] 10.222.0.20 () {60 vars in 1456 bytes} [Tue Jul 12 03:55:38 2022] DELETE /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-volume_attachments/8869bebe-69dd-49a6-a8ab-d3cfb5417803 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:55:38.910051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cf9dbf1e-8b3d-4468-9520-bd9be82a4c76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:38.911155 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-cf9dbf1e-8b3d-4468-9520-bd9be82a4c76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:38.918203 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cf9dbf1e-8b3d-4468-9520-bd9be82a4c76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:38.918203 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cf9dbf1e-8b3d-4468-9520-bd9be82a4c76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:38.918534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cf9dbf1e-8b3d-4468-9520-bd9be82a4c76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:38.918867 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cf9dbf1e-8b3d-4468-9520-bd9be82a4c76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:38.952282 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cf9dbf1e-8b3d-4468-9520-bd9be82a4c76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046436 Jul 12 03:55:38.964287 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 346/668] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jul 12 03:55:38 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:55:39.532730 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-710150dc-a833-4cc6-a48c-5ecc799ce426 req-13381248-5efa-40f2-8fc4-23c9c3945a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc703cb-c9d3-4fce-a3af-2e7253cdb910", "tag": "05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:39.554241 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-710150dc-a833-4cc6-a48c-5ecc799ce426 req-13381248-5efa-40f2-8fc4-23c9c3945a36 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:39.554880 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-710150dc-a833-4cc6-a48c-5ecc799ce426 req-13381248-5efa-40f2-8fc4-23c9c3945a36 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:39.567612 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-710150dc-a833-4cc6-a48c-5ecc799ce426 req-13381248-5efa-40f2-8fc4-23c9c3945a36 service nova] Creating event network-changed:05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3 for instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 on hv-cinder-84773 Jul 12 03:55:39.573312 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-710150dc-a833-4cc6-a48c-5ecc799ce426 req-13381248-5efa-40f2-8fc4-23c9c3945a36 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182339 Jul 12 03:55:39.574173 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 323/669] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:55:39.660659 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-54682d6a-0bac-4e9e-bacf-0860b2edf709 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:39.661257 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-54682d6a-0bac-4e9e-bacf-0860b2edf709 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:39.668027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-54682d6a-0bac-4e9e-bacf-0860b2edf709 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:39.668948 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-54682d6a-0bac-4e9e-bacf-0860b2edf709 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:39.669341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-54682d6a-0bac-4e9e-bacf-0860b2edf709 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:39.669774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-54682d6a-0bac-4e9e-bacf-0860b2edf709 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:39.681921 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-934be3cd-1155-4402-b381-d9c517a2be29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:39.682623 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-934be3cd-1155-4402-b381-d9c517a2be29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:39.689353 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-934be3cd-1155-4402-b381-d9c517a2be29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:39.689805 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-934be3cd-1155-4402-b381-d9c517a2be29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:39.690579 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-934be3cd-1155-4402-b381-d9c517a2be29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:39.691015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-934be3cd-1155-4402-b381-d9c517a2be29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:39.818936 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-54682d6a-0bac-4e9e-bacf-0860b2edf709 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:39.837051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-54682d6a-0bac-4e9e-bacf-0860b2edf709 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.180300 Jul 12 03:55:39.838063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 347/670] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:39 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:39.880482 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-934be3cd-1155-4402-b381-d9c517a2be29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:39.889692 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-934be3cd-1155-4402-b381-d9c517a2be29 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.212011 Jul 12 03:55:39.890731 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 324/671] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:39 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:55:39.974336 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-faec385a-3a38-40db-ad7a-48a0d7891968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:39.975312 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-faec385a-3a38-40db-ad7a-48a0d7891968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:39.981620 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-faec385a-3a38-40db-ad7a-48a0d7891968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:39.982073 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-faec385a-3a38-40db-ad7a-48a0d7891968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:39.982837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-faec385a-3a38-40db-ad7a-48a0d7891968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:39.983388 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-faec385a-3a38-40db-ad7a-48a0d7891968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:40.012431 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-faec385a-3a38-40db-ad7a-48a0d7891968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043871 Jul 12 03:55:40.012916 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 348/672] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jul 12 03:55:39 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:55:40.858366 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ba7f1a4d-9800-4e52-a2f7-5b46cf3042a0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:40.859454 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ba7f1a4d-9800-4e52-a2f7-5b46cf3042a0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:40.870611 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ba7f1a4d-9800-4e52-a2f7-5b46cf3042a0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:40.871352 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ba7f1a4d-9800-4e52-a2f7-5b46cf3042a0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:40.872657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ba7f1a4d-9800-4e52-a2f7-5b46cf3042a0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:40.873369 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ba7f1a4d-9800-4e52-a2f7-5b46cf3042a0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:40.907296 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-503468d0-1c03-4742-9d55-adb43cd1a756 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:40.907884 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-503468d0-1c03-4742-9d55-adb43cd1a756 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:40.914954 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-503468d0-1c03-4742-9d55-adb43cd1a756 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:40.915636 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-503468d0-1c03-4742-9d55-adb43cd1a756 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:40.916439 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-503468d0-1c03-4742-9d55-adb43cd1a756 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:40.916875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-503468d0-1c03-4742-9d55-adb43cd1a756 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:41.013091 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ba7f1a4d-9800-4e52-a2f7-5b46cf3042a0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:41.021160 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ba7f1a4d-9800-4e52-a2f7-5b46cf3042a0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.169422 Jul 12 03:55:41.021725 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 325/673] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:40 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:41.026460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-112d324d-5080-4acc-99d1-ef4c38aad102 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:41.027482 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-112d324d-5080-4acc-99d1-ef4c38aad102 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:41.033469 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-112d324d-5080-4acc-99d1-ef4c38aad102 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:41.033909 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-112d324d-5080-4acc-99d1-ef4c38aad102 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:41.034853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-112d324d-5080-4acc-99d1-ef4c38aad102 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:41.035308 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-112d324d-5080-4acc-99d1-ef4c38aad102 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:41.055826 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-503468d0-1c03-4742-9d55-adb43cd1a756 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:41.064103 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-503468d0-1c03-4742-9d55-adb43cd1a756 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.160758 Jul 12 03:55:41.064676 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 349/674] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:40 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:41.068177 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-112d324d-5080-4acc-99d1-ef4c38aad102 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045379 Jul 12 03:55:41.068741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 326/675] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jul 12 03:55:41 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:41.124150 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-45fb5fb3-00df-4477-8a1e-c9dfa2414f17 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:41.124657 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-45fb5fb3-00df-4477-8a1e-c9dfa2414f17 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:41.131194 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-45fb5fb3-00df-4477-8a1e-c9dfa2414f17 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:41.131645 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-45fb5fb3-00df-4477-8a1e-c9dfa2414f17 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:41.132450 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-45fb5fb3-00df-4477-8a1e-c9dfa2414f17 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:41.132883 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-45fb5fb3-00df-4477-8a1e-c9dfa2414f17 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:41.158467 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-45fb5fb3-00df-4477-8a1e-c9dfa2414f17 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Going to try to terminate instance {{(pid=124434) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:55:41.161128 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:41.248516 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-45fb5fb3-00df-4477-8a1e-c9dfa2414f17 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 204 len: 0 microversion: 2.20 time: 0.128296 Jul 12 03:55:41.249093 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 350/676] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jul 12 03:55:41 2022] DELETE /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 03:55:41.257529 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b4deec93-9d1c-4043-8bee-b21992ebbde7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:41.258135 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b4deec93-9d1c-4043-8bee-b21992ebbde7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:41.264368 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b4deec93-9d1c-4043-8bee-b21992ebbde7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:41.264933 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b4deec93-9d1c-4043-8bee-b21992ebbde7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:41.265683 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b4deec93-9d1c-4043-8bee-b21992ebbde7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:41.266112 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b4deec93-9d1c-4043-8bee-b21992ebbde7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:41.398849 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b4deec93-9d1c-4043-8bee-b21992ebbde7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:41.410480 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b4deec93-9d1c-4043-8bee-b21992ebbde7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:41.412634 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b4deec93-9d1c-4043-8bee-b21992ebbde7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:41.414382 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b4deec93-9d1c-4043-8bee-b21992ebbde7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.160491 Jul 12 03:55:41.415143 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 327/677] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:41 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:55:42.039458 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ad71ec8e-4e0c-45a2-99e4-b643192dde68 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:42.040174 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ad71ec8e-4e0c-45a2-99e4-b643192dde68 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:42.047271 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ad71ec8e-4e0c-45a2-99e4-b643192dde68 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:42.047722 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ad71ec8e-4e0c-45a2-99e4-b643192dde68 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:42.048529 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ad71ec8e-4e0c-45a2-99e4-b643192dde68 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:42.048963 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ad71ec8e-4e0c-45a2-99e4-b643192dde68 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:42.083348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c0243d38-aa1f-4d74-805a-7ad3701cb6d8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:42.084286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c0243d38-aa1f-4d74-805a-7ad3701cb6d8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:42.091637 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c0243d38-aa1f-4d74-805a-7ad3701cb6d8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:42.092106 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c0243d38-aa1f-4d74-805a-7ad3701cb6d8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:42.092918 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c0243d38-aa1f-4d74-805a-7ad3701cb6d8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:42.093348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c0243d38-aa1f-4d74-805a-7ad3701cb6d8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:42.178282 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ad71ec8e-4e0c-45a2-99e4-b643192dde68 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:42.185925 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ad71ec8e-4e0c-45a2-99e4-b643192dde68 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.150795 Jul 12 03:55:42.186480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 351/678] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:42 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:42.225125 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c0243d38-aa1f-4d74-805a-7ad3701cb6d8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:42.233905 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c0243d38-aa1f-4d74-805a-7ad3701cb6d8 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.156269 Jul 12 03:55:42.234472 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 328/679] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:42 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:42.439352 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f1c505b9-4c74-44b2-a6da-f5ee34854a89 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:42.440382 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f1c505b9-4c74-44b2-a6da-f5ee34854a89 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:42.450519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1c505b9-4c74-44b2-a6da-f5ee34854a89 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:42.451250 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1c505b9-4c74-44b2-a6da-f5ee34854a89 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:42.452543 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1c505b9-4c74-44b2-a6da-f5ee34854a89 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:42.453256 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1c505b9-4c74-44b2-a6da-f5ee34854a89 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:42.591241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f1c505b9-4c74-44b2-a6da-f5ee34854a89 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:42.600717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f1c505b9-4c74-44b2-a6da-f5ee34854a89 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:42.602400 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f1c505b9-4c74-44b2-a6da-f5ee34854a89 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:42.603589 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f1c505b9-4c74-44b2-a6da-f5ee34854a89 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.170904 Jul 12 03:55:42.604264 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 352/680] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:42 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:55:43.207025 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b99021ff-b08c-48f8-a1f1-ee286fe18e32 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:43.208060 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b99021ff-b08c-48f8-a1f1-ee286fe18e32 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:43.218864 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b99021ff-b08c-48f8-a1f1-ee286fe18e32 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:43.219238 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b99021ff-b08c-48f8-a1f1-ee286fe18e32 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:43.220054 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b99021ff-b08c-48f8-a1f1-ee286fe18e32 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:43.220518 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b99021ff-b08c-48f8-a1f1-ee286fe18e32 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:43.251115 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a58554aa-76f8-4b7b-b39b-1c5856b4612d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:43.251810 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a58554aa-76f8-4b7b-b39b-1c5856b4612d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:43.258996 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a58554aa-76f8-4b7b-b39b-1c5856b4612d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:43.259507 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a58554aa-76f8-4b7b-b39b-1c5856b4612d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:43.260410 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a58554aa-76f8-4b7b-b39b-1c5856b4612d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:43.260940 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a58554aa-76f8-4b7b-b39b-1c5856b4612d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:43.353903 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b99021ff-b08c-48f8-a1f1-ee286fe18e32 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:43.361666 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b99021ff-b08c-48f8-a1f1-ee286fe18e32 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.161326 Jul 12 03:55:43.362270 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 329/681] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:43 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:43.400108 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a58554aa-76f8-4b7b-b39b-1c5856b4612d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:43.408069 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a58554aa-76f8-4b7b-b39b-1c5856b4612d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.160937 Jul 12 03:55:43.408638 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 353/682] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:43 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:43.629212 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-373320bb-ef72-40a2-bade-96bbf5667549 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:43.629951 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-373320bb-ef72-40a2-bade-96bbf5667549 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:43.636273 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-373320bb-ef72-40a2-bade-96bbf5667549 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:43.636748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-373320bb-ef72-40a2-bade-96bbf5667549 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:43.637523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-373320bb-ef72-40a2-bade-96bbf5667549 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:43.637955 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-373320bb-ef72-40a2-bade-96bbf5667549 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:43.770914 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-373320bb-ef72-40a2-bade-96bbf5667549 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:43.779543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-373320bb-ef72-40a2-bade-96bbf5667549 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:43.781376 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-373320bb-ef72-40a2-bade-96bbf5667549 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:43.782712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-373320bb-ef72-40a2-bade-96bbf5667549 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.157535 Jul 12 03:55:43.783356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 330/683] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:43 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:55:44.377929 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-66c7912e-0f6a-4b9b-89a1-233b59cc34d0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:44.378541 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-66c7912e-0f6a-4b9b-89a1-233b59cc34d0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:44.385414 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66c7912e-0f6a-4b9b-89a1-233b59cc34d0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:44.385856 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66c7912e-0f6a-4b9b-89a1-233b59cc34d0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:44.386611 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66c7912e-0f6a-4b9b-89a1-233b59cc34d0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:44.387036 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66c7912e-0f6a-4b9b-89a1-233b59cc34d0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:44.429851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-601b5845-69ee-44f1-83d1-09c8ab4b38ea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:44.430435 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-601b5845-69ee-44f1-83d1-09c8ab4b38ea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:44.437519 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-601b5845-69ee-44f1-83d1-09c8ab4b38ea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:44.437693 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-601b5845-69ee-44f1-83d1-09c8ab4b38ea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:44.438464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-601b5845-69ee-44f1-83d1-09c8ab4b38ea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:44.438883 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-601b5845-69ee-44f1-83d1-09c8ab4b38ea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:44.515463 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-66c7912e-0f6a-4b9b-89a1-233b59cc34d0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:44.523524 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-66c7912e-0f6a-4b9b-89a1-233b59cc34d0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.149425 Jul 12 03:55:44.524118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 354/684] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:44 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:44.570440 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-601b5845-69ee-44f1-83d1-09c8ab4b38ea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:44.572804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:44.581081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-601b5845-69ee-44f1-83d1-09c8ab4b38ea tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.154774 Jul 12 03:55:44.581680 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 331/685] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:44 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:55:44.804031 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1dcc401f-4ab9-4022-88a5-13c07e710db2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:44.804834 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1dcc401f-4ab9-4022-88a5-13c07e710db2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:44.812927 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1dcc401f-4ab9-4022-88a5-13c07e710db2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:44.813374 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1dcc401f-4ab9-4022-88a5-13c07e710db2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:44.814142 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1dcc401f-4ab9-4022-88a5-13c07e710db2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:44.814610 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1dcc401f-4ab9-4022-88a5-13c07e710db2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:44.957472 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1dcc401f-4ab9-4022-88a5-13c07e710db2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:44.966021 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1dcc401f-4ab9-4022-88a5-13c07e710db2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:44.967519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1dcc401f-4ab9-4022-88a5-13c07e710db2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:44.968702 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1dcc401f-4ab9-4022-88a5-13c07e710db2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.169988 Jul 12 03:55:44.969275 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 355/686] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:44 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:55:45.113172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-264fb7fb-3b7b-4e98-ac40-da1f165dc0d9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:45.113660 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-264fb7fb-3b7b-4e98-ac40-da1f165dc0d9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:45.120120 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-264fb7fb-3b7b-4e98-ac40-da1f165dc0d9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:45.120571 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-264fb7fb-3b7b-4e98-ac40-da1f165dc0d9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:45.121328 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-264fb7fb-3b7b-4e98-ac40-da1f165dc0d9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:45.121759 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-264fb7fb-3b7b-4e98-ac40-da1f165dc0d9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:45.149166 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-264fb7fb-3b7b-4e98-ac40-da1f165dc0d9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:55:45.231748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-264fb7fb-3b7b-4e98-ac40-da1f165dc0d9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "DELETE /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 204 len: 0 microversion: 2.1 time: 0.122603 Jul 12 03:55:45.232426 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 332/687] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:55:45 2022] DELETE /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:55:45.241041 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-3327717f-b364-4ca3-97ea-fea488a8509d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:45.241766 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-3327717f-b364-4ca3-97ea-fea488a8509d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:45.248204 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3327717f-b364-4ca3-97ea-fea488a8509d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:45.248789 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3327717f-b364-4ca3-97ea-fea488a8509d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:45.249549 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3327717f-b364-4ca3-97ea-fea488a8509d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:45.249982 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3327717f-b364-4ca3-97ea-fea488a8509d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:45.395779 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-3327717f-b364-4ca3-97ea-fea488a8509d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:45.403775 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-3327717f-b364-4ca3-97ea-fea488a8509d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1578 microversion: 2.1 time: 0.166633 Jul 12 03:55:45.404652 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 356/688] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:45 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:45.541332 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7d2c82fa-ab1f-42be-9df2-c519bad821e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:45.541890 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7d2c82fa-ab1f-42be-9df2-c519bad821e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:45.548856 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7d2c82fa-ab1f-42be-9df2-c519bad821e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:45.549293 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7d2c82fa-ab1f-42be-9df2-c519bad821e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:45.550048 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7d2c82fa-ab1f-42be-9df2-c519bad821e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:45.550470 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7d2c82fa-ab1f-42be-9df2-c519bad821e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:45.598641 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-20fac757-a038-4095-b5bd-8844e1ea5fe6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:45.599254 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-20fac757-a038-4095-b5bd-8844e1ea5fe6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:45.605784 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-20fac757-a038-4095-b5bd-8844e1ea5fe6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:45.606242 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-20fac757-a038-4095-b5bd-8844e1ea5fe6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:45.607015 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-20fac757-a038-4095-b5bd-8844e1ea5fe6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:45.607482 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-20fac757-a038-4095-b5bd-8844e1ea5fe6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:45.687503 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-7d2c82fa-ab1f-42be-9df2-c519bad821e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:45.697802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7d2c82fa-ab1f-42be-9df2-c519bad821e0 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.160332 Jul 12 03:55:45.698575 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 333/689] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:45 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:45.756642 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-20fac757-a038-4095-b5bd-8844e1ea5fe6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:45.764978 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-20fac757-a038-4095-b5bd-8844e1ea5fe6 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1723 microversion: 2.1 time: 0.170152 Jul 12 03:55:45.768836 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 357/690] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:45 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:45.837106 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-44fdb379-8797-44e7-8a9d-6ebf93e371ef req-2ae87ea8-1ed8-4bfc-8e38-312e5856febe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc703cb-c9d3-4fce-a3af-2e7253cdb910", "name": "network-vif-plugged", "status": "completed", "tag": "05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:45.845323 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-44fdb379-8797-44e7-8a9d-6ebf93e371ef req-2ae87ea8-1ed8-4bfc-8e38-312e5856febe service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:45.845768 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-44fdb379-8797-44e7-8a9d-6ebf93e371ef req-2ae87ea8-1ed8-4bfc-8e38-312e5856febe service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:45.856637 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-44fdb379-8797-44e7-8a9d-6ebf93e371ef req-2ae87ea8-1ed8-4bfc-8e38-312e5856febe service nova] Creating event network-vif-plugged:05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3 for instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 on hv-cinder-84773 Jul 12 03:55:45.861970 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-44fdb379-8797-44e7-8a9d-6ebf93e371ef req-2ae87ea8-1ed8-4bfc-8e38-312e5856febe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085234 Jul 12 03:55:45.862568 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 334/691] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:55:45.987081 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9fa5fd42-63ea-4b09-8eb9-fbd876691ccc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:45.987674 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-9fa5fd42-63ea-4b09-8eb9-fbd876691ccc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:45.994388 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9fa5fd42-63ea-4b09-8eb9-fbd876691ccc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:45.994842 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9fa5fd42-63ea-4b09-8eb9-fbd876691ccc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:45.995607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9fa5fd42-63ea-4b09-8eb9-fbd876691ccc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:45.996047 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9fa5fd42-63ea-4b09-8eb9-fbd876691ccc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:46.133663 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9fa5fd42-63ea-4b09-8eb9-fbd876691ccc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:46.142088 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9fa5fd42-63ea-4b09-8eb9-fbd876691ccc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:46.143611 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9fa5fd42-63ea-4b09-8eb9-fbd876691ccc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:46.144818 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9fa5fd42-63ea-4b09-8eb9-fbd876691ccc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.161881 Jul 12 03:55:46.145821 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 358/692] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:45 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:55:46.427880 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-30639340-d5ab-4b0a-9f77-7396fd6bf3ab tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:46.428817 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-30639340-d5ab-4b0a-9f77-7396fd6bf3ab tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:46.435388 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30639340-d5ab-4b0a-9f77-7396fd6bf3ab tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:46.435835 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30639340-d5ab-4b0a-9f77-7396fd6bf3ab tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:46.436638 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30639340-d5ab-4b0a-9f77-7396fd6bf3ab tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:46.437108 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30639340-d5ab-4b0a-9f77-7396fd6bf3ab tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:46.569493 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-30639340-d5ab-4b0a-9f77-7396fd6bf3ab tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:46.578997 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-30639340-d5ab-4b0a-9f77-7396fd6bf3ab tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1578 microversion: 2.1 time: 0.155543 Jul 12 03:55:46.579561 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 335/693] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:46 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:46.718504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8647f11d-e3e2-439d-9410-3a04098678d3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:46.719119 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8647f11d-e3e2-439d-9410-3a04098678d3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:46.726297 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8647f11d-e3e2-439d-9410-3a04098678d3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:46.726757 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8647f11d-e3e2-439d-9410-3a04098678d3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:46.727518 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8647f11d-e3e2-439d-9410-3a04098678d3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:46.727954 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8647f11d-e3e2-439d-9410-3a04098678d3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:46.782786 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-12c562c7-5900-40a0-a469-228e312de95f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:46.783401 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-12c562c7-5900-40a0-a469-228e312de95f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:46.789531 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-12c562c7-5900-40a0-a469-228e312de95f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:46.789990 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-12c562c7-5900-40a0-a469-228e312de95f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:46.790770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-12c562c7-5900-40a0-a469-228e312de95f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:46.791193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-12c562c7-5900-40a0-a469-228e312de95f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:46.859797 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8647f11d-e3e2-439d-9410-3a04098678d3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:46.867835 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8647f11d-e3e2-439d-9410-3a04098678d3 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.153387 Jul 12 03:55:46.868459 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 359/694] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:46 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:46.933317 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-12c562c7-5900-40a0-a469-228e312de95f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:46.942166 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-12c562c7-5900-40a0-a469-228e312de95f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1729 microversion: 2.1 time: 0.163416 Jul 12 03:55:46.942801 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 336/695] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:46 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:55:46.959280 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-729b2657-2bf7-427d-926f-2699a40a4167 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:46.960068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-729b2657-2bf7-427d-926f-2699a40a4167 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:46.966790 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-729b2657-2bf7-427d-926f-2699a40a4167 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:46.967241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-729b2657-2bf7-427d-926f-2699a40a4167 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:46.968138 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-729b2657-2bf7-427d-926f-2699a40a4167 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:46.968669 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-729b2657-2bf7-427d-926f-2699a40a4167 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:47.051945 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-729b2657-2bf7-427d-926f-2699a40a4167 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096699 Jul 12 03:55:47.052606 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 360/696] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 03:55:46 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:55:47.164101 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1eb1726e-696d-4a06-9bbe-6edd523b6b88 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:47.164697 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1eb1726e-696d-4a06-9bbe-6edd523b6b88 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:47.171262 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1eb1726e-696d-4a06-9bbe-6edd523b6b88 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:47.171696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1eb1726e-696d-4a06-9bbe-6edd523b6b88 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:47.172497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1eb1726e-696d-4a06-9bbe-6edd523b6b88 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:47.172921 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1eb1726e-696d-4a06-9bbe-6edd523b6b88 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:47.313654 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1eb1726e-696d-4a06-9bbe-6edd523b6b88 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:47.322399 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1eb1726e-696d-4a06-9bbe-6edd523b6b88 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:47.323873 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1eb1726e-696d-4a06-9bbe-6edd523b6b88 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:47.325048 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1eb1726e-696d-4a06-9bbe-6edd523b6b88 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.165278 Jul 12 03:55:47.325615 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 337/697] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:47 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:55:47.595802 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-93cce9e5-e4b7-49dd-bf5c-acac857502b5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:47.596441 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-93cce9e5-e4b7-49dd-bf5c-acac857502b5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:47.602627 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-93cce9e5-e4b7-49dd-bf5c-acac857502b5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:47.603082 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-93cce9e5-e4b7-49dd-bf5c-acac857502b5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:47.603844 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-93cce9e5-e4b7-49dd-bf5c-acac857502b5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:47.604322 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-93cce9e5-e4b7-49dd-bf5c-acac857502b5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:47.885211 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-cf49a510-4eda-4a3b-8fab-426ddd511650 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:47.885851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-cf49a510-4eda-4a3b-8fab-426ddd511650 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:47.893569 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cf49a510-4eda-4a3b-8fab-426ddd511650 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:47.894024 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cf49a510-4eda-4a3b-8fab-426ddd511650 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:47.894809 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cf49a510-4eda-4a3b-8fab-426ddd511650 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:47.895613 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cf49a510-4eda-4a3b-8fab-426ddd511650 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:48.039373 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-cf49a510-4eda-4a3b-8fab-426ddd511650 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:48.048050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-cf49a510-4eda-4a3b-8fab-426ddd511650 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.166574 Jul 12 03:55:48.048698 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 338/698] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:47 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:55:48.107649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-93cce9e5-e4b7-49dd-bf5c-acac857502b5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:48.115797 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-93cce9e5-e4b7-49dd-bf5c-acac857502b5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1578 microversion: 2.1 time: 0.523937 Jul 12 03:55:48.116365 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 361/699] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:47 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1578 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:48.342854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c4dcbb47-5e5d-4abb-8cc5-8802485840f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:48.344850 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c4dcbb47-5e5d-4abb-8cc5-8802485840f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:48.350033 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-b8ea757c-7cb6-4678-b95a-b02e176e9cc6 req-d56b7245-75a8-4a22-a336-5b1ef59b57eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e3bc04-35b0-412b-b8d6-65165bc79e60", "tag": "a1b17494-72de-4c33-8c66-6af3d34f96b4"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:48.351513 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4dcbb47-5e5d-4abb-8cc5-8802485840f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:48.351965 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4dcbb47-5e5d-4abb-8cc5-8802485840f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:48.353836 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4dcbb47-5e5d-4abb-8cc5-8802485840f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:48.354273 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c4dcbb47-5e5d-4abb-8cc5-8802485840f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:48.360778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-b8ea757c-7cb6-4678-b95a-b02e176e9cc6 req-d56b7245-75a8-4a22-a336-5b1ef59b57eb service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:48.361231 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-b8ea757c-7cb6-4678-b95a-b02e176e9cc6 req-d56b7245-75a8-4a22-a336-5b1ef59b57eb service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:48.375484 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-b8ea757c-7cb6-4678-b95a-b02e176e9cc6 req-d56b7245-75a8-4a22-a336-5b1ef59b57eb service nova] Creating event network-changed:a1b17494-72de-4c33-8c66-6af3d34f96b4 for instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 on hv-cinder-84773 Jul 12 03:55:48.380618 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-b8ea757c-7cb6-4678-b95a-b02e176e9cc6 req-d56b7245-75a8-4a22-a336-5b1ef59b57eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092049 Jul 12 03:55:48.381211 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 339/700] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:55:48.490225 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c4dcbb47-5e5d-4abb-8cc5-8802485840f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:48.498206 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c4dcbb47-5e5d-4abb-8cc5-8802485840f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:48.499791 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c4dcbb47-5e5d-4abb-8cc5-8802485840f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:48.500980 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c4dcbb47-5e5d-4abb-8cc5-8802485840f3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.162158 Jul 12 03:55:48.501518 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 362/701] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:48 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:55:49.067717 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-423c253a-765d-447e-8d9d-656910ff51a8 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:49.068511 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-423c253a-765d-447e-8d9d-656910ff51a8 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:49.075331 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-423c253a-765d-447e-8d9d-656910ff51a8 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:49.075740 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-423c253a-765d-447e-8d9d-656910ff51a8 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:49.076760 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-423c253a-765d-447e-8d9d-656910ff51a8 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:49.077221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-423c253a-765d-447e-8d9d-656910ff51a8 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:49.137170 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-42a4c455-6c44-4c08-ade0-9fc66cd02e8c tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:49.138436 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-42a4c455-6c44-4c08-ade0-9fc66cd02e8c tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:49.146799 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-42a4c455-6c44-4c08-ade0-9fc66cd02e8c tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:49.147481 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-42a4c455-6c44-4c08-ade0-9fc66cd02e8c tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:49.148286 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-42a4c455-6c44-4c08-ade0-9fc66cd02e8c tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:49.148728 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-42a4c455-6c44-4c08-ade0-9fc66cd02e8c tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:49.350917 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-42a4c455-6c44-4c08-ade0-9fc66cd02e8c tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:49.363752 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-42a4c455-6c44-4c08-ade0-9fc66cd02e8c tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1578 microversion: 2.1 time: 0.231601 Jul 12 03:55:49.365175 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 363/702] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:49 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1578 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:55:49.519515 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-811b5026-fdaf-4040-b268-aa5db9b9e8f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:49.520523 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-811b5026-fdaf-4040-b268-aa5db9b9e8f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:49.527042 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-811b5026-fdaf-4040-b268-aa5db9b9e8f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:49.527504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-811b5026-fdaf-4040-b268-aa5db9b9e8f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:49.528338 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-811b5026-fdaf-4040-b268-aa5db9b9e8f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:49.528785 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-811b5026-fdaf-4040-b268-aa5db9b9e8f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:49.536618 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-423c253a-765d-447e-8d9d-656910ff51a8 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:49.545990 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-423c253a-765d-447e-8d9d-656910ff51a8 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1358 microversion: 2.1 time: 0.482635 Jul 12 03:55:49.557241 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 340/703] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:49 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1358 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:49.692248 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-811b5026-fdaf-4040-b268-aa5db9b9e8f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:49.701068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-811b5026-fdaf-4040-b268-aa5db9b9e8f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:49.702714 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-811b5026-fdaf-4040-b268-aa5db9b9e8f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:49.703793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-811b5026-fdaf-4040-b268-aa5db9b9e8f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1723 microversion: 2.20 time: 0.188448 Jul 12 03:55:49.704389 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 364/704] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:49 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:55:50.384763 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3addfcb6-fcf4-40f9-a376-aeb0d03bb56f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:50.385532 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3addfcb6-fcf4-40f9-a376-aeb0d03bb56f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:50.396446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3addfcb6-fcf4-40f9-a376-aeb0d03bb56f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:50.398838 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3addfcb6-fcf4-40f9-a376-aeb0d03bb56f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:50.399762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-7ecad3d1-a107-4e06-a0e4-cd957e91586d req-2b772ce2-edc1-430c-8c8d-1e61d2ab9a86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e3bc04-35b0-412b-b8d6-65165bc79e60", "tag": "a1b17494-72de-4c33-8c66-6af3d34f96b4"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:50.400694 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3addfcb6-fcf4-40f9-a376-aeb0d03bb56f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:50.401406 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3addfcb6-fcf4-40f9-a376-aeb0d03bb56f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:50.422558 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-7ecad3d1-a107-4e06-a0e4-cd957e91586d req-2b772ce2-edc1-430c-8c8d-1e61d2ab9a86 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:50.423533 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-7ecad3d1-a107-4e06-a0e4-cd957e91586d req-2b772ce2-edc1-430c-8c8d-1e61d2ab9a86 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:50.452382 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-7ecad3d1-a107-4e06-a0e4-cd957e91586d req-2b772ce2-edc1-430c-8c8d-1e61d2ab9a86 service nova] Creating event network-changed:a1b17494-72de-4c33-8c66-6af3d34f96b4 for instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 on hv-cinder-84773 Jul 12 03:55:50.460379 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-7ecad3d1-a107-4e06-a0e4-cd957e91586d req-2b772ce2-edc1-430c-8c8d-1e61d2ab9a86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066885 Jul 12 03:55:50.461147 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 365/705] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:55:50.563983 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7abba82d-91df-400b-98db-6aa541dd4e00 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:50.565124 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7abba82d-91df-400b-98db-6aa541dd4e00 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:50.572251 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7abba82d-91df-400b-98db-6aa541dd4e00 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:50.572933 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7abba82d-91df-400b-98db-6aa541dd4e00 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:50.573920 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7abba82d-91df-400b-98db-6aa541dd4e00 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:50.574504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7abba82d-91df-400b-98db-6aa541dd4e00 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:50.720830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3addfcb6-fcf4-40f9-a376-aeb0d03bb56f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:50.723023 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7abba82d-91df-400b-98db-6aa541dd4e00 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:50.745473 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:50.748412 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7abba82d-91df-400b-98db-6aa541dd4e00 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1548 microversion: 2.1 time: 0.189124 Jul 12 03:55:50.749757 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 366/706] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:50 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1548 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:50.755544 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-14948c8b-478d-480a-b9a6-ae7d059da226 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:50.756442 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-14948c8b-478d-480a-b9a6-ae7d059da226 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:50.766442 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-14948c8b-478d-480a-b9a6-ae7d059da226 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:50.767243 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-14948c8b-478d-480a-b9a6-ae7d059da226 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:50.768184 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3addfcb6-fcf4-40f9-a376-aeb0d03bb56f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1578 microversion: 2.1 time: 0.389070 Jul 12 03:55:50.768844 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 341/707] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:50 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1578 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:50.776944 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-060015a7-9971-415c-ab5a-333db0d5296d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:50.777739 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-060015a7-9971-415c-ab5a-333db0d5296d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:50.780068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-14948c8b-478d-480a-b9a6-ae7d059da226 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:50.780852 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-14948c8b-478d-480a-b9a6-ae7d059da226 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:50.785921 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-060015a7-9971-415c-ab5a-333db0d5296d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:50.786629 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-060015a7-9971-415c-ab5a-333db0d5296d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:50.787585 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-060015a7-9971-415c-ab5a-333db0d5296d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:50.788205 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-060015a7-9971-415c-ab5a-333db0d5296d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:50.863464 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-14948c8b-478d-480a-b9a6-ae7d059da226 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:50.873612 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-14948c8b-478d-480a-b9a6-ae7d059da226 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:50.875772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-14948c8b-478d-480a-b9a6-ae7d059da226 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:50.878413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-14948c8b-478d-480a-b9a6-ae7d059da226 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 200 len: 1656 microversion: 2.20 time: 0.127290 Jul 12 03:55:50.879561 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 367/708] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:50 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 1656 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:55:50.893310 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-709cac28-9cd9-4831-a900-6c65db1dd208 req-5b7b0a76-9b2f-4632-8740-1cdb08dbc1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae771f5b-03de-46db-82fc-cd94d731405a", "name": "network-vif-deleted", "tag": "28823cfb-b758-4345-b841-353bcf53f8b8"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:50.902630 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-709cac28-9cd9-4831-a900-6c65db1dd208 req-5b7b0a76-9b2f-4632-8740-1cdb08dbc1b6 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:50.903322 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-709cac28-9cd9-4831-a900-6c65db1dd208 req-5b7b0a76-9b2f-4632-8740-1cdb08dbc1b6 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:50.916691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-709cac28-9cd9-4831-a900-6c65db1dd208 req-5b7b0a76-9b2f-4632-8740-1cdb08dbc1b6 service nova] Creating event network-vif-deleted:28823cfb-b758-4345-b841-353bcf53f8b8 for instance ae771f5b-03de-46db-82fc-cd94d731405a on hv-cinder-84773 Jul 12 03:55:50.924778 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-709cac28-9cd9-4831-a900-6c65db1dd208 req-5b7b0a76-9b2f-4632-8740-1cdb08dbc1b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037192 Jul 12 03:55:50.928336 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 368/709] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:55:51.066284 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-060015a7-9971-415c-ab5a-333db0d5296d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:51.077959 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-060015a7-9971-415c-ab5a-333db0d5296d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1548 microversion: 2.1 time: 0.306680 Jul 12 03:55:51.082894 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 342/710] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:50 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1548 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:51.098978 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e4e28e03-3a58-419b-93af-cec23f337903 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:51.102587 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e4e28e03-3a58-419b-93af-cec23f337903 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:51.103399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e4e28e03-3a58-419b-93af-cec23f337903 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Searching by: {'deleted': False, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd'} {{(pid=124434) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 03:55:51.115739 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e4e28e03-3a58-419b-93af-cec23f337903 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:51.115739 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e4e28e03-3a58-419b-93af-cec23f337903 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:51.118436 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e4e28e03-3a58-419b-93af-cec23f337903 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:51.118885 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e4e28e03-3a58-419b-93af-cec23f337903 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:51.219417 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.multi_cell_list [None req-e4e28e03-3a58-419b-93af-cec23f337903 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124434) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 03:55:51.414989 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e4e28e03-3a58-419b-93af-cec23f337903 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.320926 Jul 12 03:55:51.415599 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 369/711] 10.222.0.20 () {58 vars in 1124 bytes} [Tue Jul 12 03:55:51 2022] GET /compute/v2.1/servers => generated 343 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:55:51.426302 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fc338759-9b9b-4600-9485-72ea2e5a1347 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:51.427510 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-fc338759-9b9b-4600-9485-72ea2e5a1347 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:51.438804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fc338759-9b9b-4600-9485-72ea2e5a1347 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:51.439251 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fc338759-9b9b-4600-9485-72ea2e5a1347 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:51.440072 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fc338759-9b9b-4600-9485-72ea2e5a1347 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:51.444997 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fc338759-9b9b-4600-9485-72ea2e5a1347 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:51.788281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-fc338759-9b9b-4600-9485-72ea2e5a1347 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:51.794988 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1adf7536-78ae-4f4a-be8e-dcac3dc08b07 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:51.797523 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1adf7536-78ae-4f4a-be8e-dcac3dc08b07 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:51.817088 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-fc338759-9b9b-4600-9485-72ea2e5a1347 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1548 microversion: 2.1 time: 0.394078 Jul 12 03:55:51.827456 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 343/712] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:51 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1548 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:51.827691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1adf7536-78ae-4f4a-be8e-dcac3dc08b07 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:51.827691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1adf7536-78ae-4f4a-be8e-dcac3dc08b07 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:51.827691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1adf7536-78ae-4f4a-be8e-dcac3dc08b07 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:51.827691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1adf7536-78ae-4f4a-be8e-dcac3dc08b07 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:51.899377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f2e8a6ee-14b5-4d7b-a900-3e9e33ccdb76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:51.900307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f2e8a6ee-14b5-4d7b-a900-3e9e33ccdb76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:51.911718 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f2e8a6ee-14b5-4d7b-a900-3e9e33ccdb76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:51.912692 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f2e8a6ee-14b5-4d7b-a900-3e9e33ccdb76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:51.914585 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f2e8a6ee-14b5-4d7b-a900-3e9e33ccdb76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:51.915044 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f2e8a6ee-14b5-4d7b-a900-3e9e33ccdb76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:51.960844 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1adf7536-78ae-4f4a-be8e-dcac3dc08b07 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:51.967710 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-f2e8a6ee-14b5-4d7b-a900-3e9e33ccdb76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] HTTP exception thrown: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 03:55:51.978152 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1adf7536-78ae-4f4a-be8e-dcac3dc08b07 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 200 len: 1225 microversion: 2.1 time: 0.195261 Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f2e8a6ee-14b5-4d7b-a900-3e9e33ccdb76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Request method failure captured: Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a HTTP/1.1 Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO88sMKBC-68lnxLFtEdk9rhON0yYCN-r7zPJSNYf8_kMKEMAYORFEp5ctyZtoFZmyHbvfrJjALpYcPvL9qi0rSpqkJk9axiu64shKgTjIuPSEPVK4wYPKJgBzthkzIcaErfaB63QYc7wm5jVNPYFB0YNH6siHhLjxUiaNZ94K4fycY Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: e9417b8011914e108ae00b5aa583ce50 Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:55:51.984559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:55:51.986050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9417b8011914e108ae00b5aa583ce50"}]}] Jul 12 03:55:51.986050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 03:55:51.986050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: e9417b8011914e108ae00b5aa583ce50 Jul 12 03:55:51.986050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 03:55:51.986050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeShelveTestJSON-375334058-project Jul 12 03:55:51.986050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:55:51.986050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:55:51.986050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: bf67549bf7e443c6b77eaf71fb6b709c Jul 12 03:55:51.986050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeShelveTestJSON-375334058-project Jul 12 03:55:51.986050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 03:55:51.986050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 03:55:51.986050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'ae771f5b-03de-46db-82fc-cd94d731405a'} Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:55:51.986857 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 03:55:51.988167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:55:51.991537 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f2e8a6ee-14b5-4d7b-a900-3e9e33ccdb76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Returning 404 to user: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:55:51.992430 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 370/713] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:51 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 1225 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:51.995372 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f2e8a6ee-14b5-4d7b-a900-3e9e33ccdb76 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 404 len: 111 microversion: 2.20 time: 0.101761 Jul 12 03:55:52.005427 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 344/714] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:51 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 03:55:52.009022 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c6929bf5-923c-41dc-afcb-38f8d23bc300 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '.version_select at 0x7fd7fa3ef0d0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:52.050593 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c6929bf5-923c-41dc-afcb-38f8d23bc300 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064268308" status: 204 len: 0 microversion: 2.20 time: 0.047414 Jul 12 03:55:52.052059 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 371/715] 10.222.0.20 () {60 vars in 1261 bytes} [Tue Jul 12 03:55:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064268308 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 03:55:52.971134 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-f0e5196c-713b-4cf4-899c-00dca188ce9f req-3ba92b58-41f4-4cfa-9cca-5beb4b8b9e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f988bb-503a-447f-a796-236af82ab9f6", "name": "network-vif-deleted", "tag": "4ba9303d-bc54-4f55-bfa4-2008f5d2bd62"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:52.985370 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-f0e5196c-713b-4cf4-899c-00dca188ce9f req-3ba92b58-41f4-4cfa-9cca-5beb4b8b9e4f service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:52.985810 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-f0e5196c-713b-4cf4-899c-00dca188ce9f req-3ba92b58-41f4-4cfa-9cca-5beb4b8b9e4f service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:52.986765 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7744192b-7f55-4960-bccb-418bf4408d97 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Action: 'create', calling method: .version_select at 0x7fd7fa3c6dc0>, body: {"keypair": {"name": "tempest-keypair-995521979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi2sEE1iM4V8RKC2VF1CGsXCu/5u4y6m0kVDPgyBB4iF83ngVtfB38oCt0e6fEYC0I/Eaa4HpDtVMETOmTty4rdUbfPQbfo4bAQqAQ8oX+H5REYfilASLVNAYIu13vEJw=="}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:53.001314 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-f0e5196c-713b-4cf4-899c-00dca188ce9f req-3ba92b58-41f4-4cfa-9cca-5beb4b8b9e4f service nova] Creating event network-vif-deleted:4ba9303d-bc54-4f55-bfa4-2008f5d2bd62 for instance 58f988bb-503a-447f-a796-236af82ab9f6 on hv-cinder-84773 Jul 12 03:55:53.003364 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-7744192b-7f55-4960-bccb-418bf4408d97 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Getting quotas for project e9417b8011914e108ae00b5aa583ce50. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:55:53.008216 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-7744192b-7f55-4960-bccb-418bf4408d97 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Getting quotas for user bf67549bf7e443c6b77eaf71fb6b709c and project e9417b8011914e108ae00b5aa583ce50. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:55:53.008481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-f0e5196c-713b-4cf4-899c-00dca188ce9f req-3ba92b58-41f4-4cfa-9cca-5beb4b8b9e4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043239 Jul 12 03:55:53.009340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 345/716] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:55:53.014262 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-517a6699-746e-4969-b1c2-97c185744e17 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:53.015001 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-517a6699-746e-4969-b1c2-97c185744e17 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:53.022182 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-517a6699-746e-4969-b1c2-97c185744e17 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:53.022760 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-517a6699-746e-4969-b1c2-97c185744e17 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:53.023537 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-517a6699-746e-4969-b1c2-97c185744e17 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:53.023973 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-517a6699-746e-4969-b1c2-97c185744e17 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:53.031203 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7744192b-7f55-4960-bccb-418bf4408d97 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050015 Jul 12 03:55:53.031813 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 372/717] 10.222.0.20 () {62 vars in 1199 bytes} [Tue Jul 12 03:55:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 03:55:53.038912 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-517a6699-746e-4969-b1c2-97c185744e17 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] HTTP exception thrown: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-517a6699-746e-4969-b1c2-97c185744e17 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Request method failure captured: Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 HTTP/1.1 Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO-8dpqzFzcrMCwqDwKjSU2VKruOD36zfE4WUHD_UvZUXRjz_J21oJmVhAiu7kpxRHTvSZNc1KEs2RJnDGiiNwCVQTjz6Ue8nGMcLQsM6XF3zmKzP_EBrxmIwgay9qHtOmCbmvpx8bbBjSxehF3uy9s0OVGu4VRKaONcH2bTLous7NI Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 99d9e85c63234c77889f856bf95288f5 Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-TestVolumeBootPattern-1773194956 Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:55:53.040778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:55:53.042296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99d9e85c63234c77889f856bf95288f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99d9e85c63234c77889f856bf95288f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99d9e85c63234c77889f856bf95288f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99d9e85c63234c77889f856bf95288f5"}]}] Jul 12 03:55:53.042296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-TestVolumeBootPattern-1773194956 Jul 12 03:55:53.042296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 99d9e85c63234c77889f856bf95288f5 Jul 12 03:55:53.042296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-TestVolumeBootPattern-1773194956 Jul 12 03:55:53.042296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-TestVolumeBootPattern-1773194956-project Jul 12 03:55:53.042296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:55:53.042296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:55:53.042296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 46d5c3f98d924538a34c4b3a57fcac14 Jul 12 03:55:53.042296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-TestVolumeBootPattern-1773194956-project Jul 12 03:55:53.042296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 03:55:53.042296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 03:55:53.042296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': '58f988bb-503a-447f-a796-236af82ab9f6'} Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:55:53.043300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 03:55:53.044738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:55:53.046244 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-517a6699-746e-4969-b1c2-97c185744e17 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Returning 404 to user: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:55:53.046244 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-517a6699-746e-4969-b1c2-97c185744e17 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 404 len: 111 microversion: 2.1 time: 0.031906 Jul 12 03:55:53.048207 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 346/718] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:53 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:55:53.168680 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1407729988", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-359074052", "security_groups": [{"name": "tempest-secgroup-smoke-360543779"}], "block_device_mapping_v2": [{"uuid": "063903b2-301d-4e84-97d8-a2eda2c3be57", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb793af7-088d-44b6-bebd-8609e6743321"}]}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:53.318504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.network.neutron [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] validate_networks() for [('cb793af7-088d-44b6-bebd-8609e6743321', None, None, None, None, None)] {{(pid=124434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:55:53.727074 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e1135d70-563c-45a7-8bc7-6f67fe4df51c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8eedbc6a-890f-4866-bc06-df0312210c08"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:53.728643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e1135d70-563c-45a7-8bc7-6f67fe4df51c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:53.734092 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Flavor limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:55:53.734603 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Image limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:55:53.735073 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Flavor pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:55:53.735670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Image pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:55:53.736429 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:55:53.737375 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e1135d70-563c-45a7-8bc7-6f67fe4df51c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:53.737823 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e1135d70-563c-45a7-8bc7-6f67fe4df51c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:53.738606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e1135d70-563c-45a7-8bc7-6f67fe4df51c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:53.739042 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e1135d70-563c-45a7-8bc7-6f67fe4df51c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:53.745929 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:53.746429 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:53.747228 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:53.747661 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:53.768210 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Getting quotas for project 99d9e85c63234c77889f856bf95288f5. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:55:53.773436 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Getting quotas for user 46d5c3f98d924538a34c4b3a57fcac14 and project 99d9e85c63234c77889f856bf95288f5. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:55:53.776257 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:53.837130 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Going to run 1 instances... {{(pid=124434) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:55:53.839236 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='063903b2-301d-4e84-97d8-a2eda2c3be57',volume_size=None,volume_type=None)] {{(pid=124434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:55:54.030710 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-22e626de-3f1a-47b7-9b0a-ec925e6f310b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.866126 Jul 12 03:55:54.031740 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 373/719] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:55:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 03:55:54.042493 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e7889eae-8763-4c43-ac00-6873da13c1cb tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:54.043249 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e7889eae-8763-4c43-ac00-6873da13c1cb tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:54.063807 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e1135d70-563c-45a7-8bc7-6f67fe4df51c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "POST /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341119 Jul 12 03:55:54.065602 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 347/720] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 03:55:53 2022] POST /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 03:55:54.146267 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e7889eae-8763-4c43-ac00-6873da13c1cb tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:54.155017 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e7889eae-8763-4c43-ac00-6873da13c1cb tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1094 microversion: 2.1 time: 0.117198 Jul 12 03:55:54.155674 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 374/721] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:54 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1094 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:54.496651 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2102339086", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f76dcd0-bea2-4820-bfd4-ddc4ed91af3b"}], "security_groups": [{"name": "tempest-securitygroup--1648301715"}], "key_name": "tempest-keypair-995521979", "user_data": "}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:54.608713 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.network.neutron [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] validate_networks() for [('8f76dcd0-bea2-4820-bfd4-ddc4ed91af3b', None, None, None, None, None)] {{(pid=124435) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:55:55.028465 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Flavor limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:55:55.028907 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Image limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:55:55.029373 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Flavor pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:55:55.029776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Image pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:55:55.030365 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:55:55.040284 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:55.040727 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:55.041964 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:55.041964 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:55.058656 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Getting quotas for project e9417b8011914e108ae00b5aa583ce50. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:55:55.062746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Getting quotas for user bf67549bf7e443c6b77eaf71fb6b709c and project e9417b8011914e108ae00b5aa583ce50. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:55:55.073639 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Going to run 1 instances... {{(pid=124435) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:55:55.076029 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124435) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:55:55.129142 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-38a6f327-cd18-437a-9ae8-6d27b9ec7690 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.638437 Jul 12 03:55:55.130429 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 348/722] 10.222.0.20 () {62 vars in 1187 bytes} [Tue Jul 12 03:55:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 12 03:55:55.141321 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-189927c4-88c5-4440-96d3-d6c92c61f968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:55.143182 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-189927c4-88c5-4440-96d3-d6c92c61f968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:55.173869 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2223c7d5-9882-40a6-a1fc-38f52f45f786 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:55.174994 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-2223c7d5-9882-40a6-a1fc-38f52f45f786 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:55.184392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2223c7d5-9882-40a6-a1fc-38f52f45f786 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:55.185424 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2223c7d5-9882-40a6-a1fc-38f52f45f786 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:55.186867 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2223c7d5-9882-40a6-a1fc-38f52f45f786 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:55.187518 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2223c7d5-9882-40a6-a1fc-38f52f45f786 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:55.219469 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:55:55.277570 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-189927c4-88c5-4440-96d3-d6c92c61f968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:55.286055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-189927c4-88c5-4440-96d3-d6c92c61f968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:55.288206 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-189927c4-88c5-4440-96d3-d6c92c61f968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:55.289487 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-189927c4-88c5-4440-96d3-d6c92c61f968 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1281 microversion: 2.20 time: 0.152037 Jul 12 03:55:55.290273 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 375/723] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:55 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1281 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:55:55.308788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-2223c7d5-9882-40a6-a1fc-38f52f45f786 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:55.317397 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-2223c7d5-9882-40a6-a1fc-38f52f45f786 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1210 microversion: 2.1 time: 0.148600 Jul 12 03:55:55.318371 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 349/724] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:55 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1210 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:56.306947 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ae5c7d7f-039f-4dfc-bf5e-28a1881e4e14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:56.308311 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ae5c7d7f-039f-4dfc-bf5e-28a1881e4e14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:56.315599 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ae5c7d7f-039f-4dfc-bf5e-28a1881e4e14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:56.316373 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ae5c7d7f-039f-4dfc-bf5e-28a1881e4e14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:56.322250 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ae5c7d7f-039f-4dfc-bf5e-28a1881e4e14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:56.322869 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ae5c7d7f-039f-4dfc-bf5e-28a1881e4e14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:56.337829 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0eb404d7-e48a-4ed4-b58a-7d0214c644e8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:56.338415 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0eb404d7-e48a-4ed4-b58a-7d0214c644e8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:56.356882 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0eb404d7-e48a-4ed4-b58a-7d0214c644e8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:56.357645 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0eb404d7-e48a-4ed4-b58a-7d0214c644e8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:56.359733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0eb404d7-e48a-4ed4-b58a-7d0214c644e8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:56.361609 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0eb404d7-e48a-4ed4-b58a-7d0214c644e8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:56.425372 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ae5c7d7f-039f-4dfc-bf5e-28a1881e4e14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:56.432905 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ae5c7d7f-039f-4dfc-bf5e-28a1881e4e14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:56.434740 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ae5c7d7f-039f-4dfc-bf5e-28a1881e4e14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:56.436051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ae5c7d7f-039f-4dfc-bf5e-28a1881e4e14 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1351 microversion: 2.20 time: 0.133105 Jul 12 03:55:56.436830 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 376/725] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:56 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1351 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:55:56.692748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0eb404d7-e48a-4ed4-b58a-7d0214c644e8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:56.700940 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0eb404d7-e48a-4ed4-b58a-7d0214c644e8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1277 microversion: 2.1 time: 0.369646 Jul 12 03:55:56.701863 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 350/726] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:56 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1277 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:57.406230 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-afa9854c-bdec-46a2-89ab-11df7c047734 req-4ccdb43f-308a-479d-8cc8-2ec3b7a8beb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "235a37d4-1517-4ea0-ab89-8b63a0413983", "tag": "a2e41b8a-4d2a-40b4-904c-82ef5d61e3b3"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:57.418405 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-afa9854c-bdec-46a2-89ab-11df7c047734 req-4ccdb43f-308a-479d-8cc8-2ec3b7a8beb5 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:57.419180 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-afa9854c-bdec-46a2-89ab-11df7c047734 req-4ccdb43f-308a-479d-8cc8-2ec3b7a8beb5 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:57.447206 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-afa9854c-bdec-46a2-89ab-11df7c047734 req-4ccdb43f-308a-479d-8cc8-2ec3b7a8beb5 service nova] Creating event network-changed:a2e41b8a-4d2a-40b4-904c-82ef5d61e3b3 for instance 235a37d4-1517-4ea0-ab89-8b63a0413983 on hv-cinder-84773 Jul 12 03:55:57.456822 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-afa9854c-bdec-46a2-89ab-11df7c047734 req-4ccdb43f-308a-479d-8cc8-2ec3b7a8beb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055630 Jul 12 03:55:57.457703 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 377/727] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:55:57.458501 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bdd547ec-d3ab-4379-83b4-686e0168b010 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:57.459124 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-bdd547ec-d3ab-4379-83b4-686e0168b010 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:57.470697 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bdd547ec-d3ab-4379-83b4-686e0168b010 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:57.471210 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bdd547ec-d3ab-4379-83b4-686e0168b010 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:57.472169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bdd547ec-d3ab-4379-83b4-686e0168b010 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:57.472773 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bdd547ec-d3ab-4379-83b4-686e0168b010 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:57.719400 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-403f7c98-9425-40b4-81d5-ee78b353b441 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:57.720907 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-403f7c98-9425-40b4-81d5-ee78b353b441 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:57.727327 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-403f7c98-9425-40b4-81d5-ee78b353b441 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:57.727798 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-403f7c98-9425-40b4-81d5-ee78b353b441 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:57.728619 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-403f7c98-9425-40b4-81d5-ee78b353b441 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:57.729240 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-403f7c98-9425-40b4-81d5-ee78b353b441 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:57.800628 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bdd547ec-d3ab-4379-83b4-686e0168b010 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:57.810004 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bdd547ec-d3ab-4379-83b4-686e0168b010 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:57.811718 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bdd547ec-d3ab-4379-83b4-686e0168b010 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:57.813049 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bdd547ec-d3ab-4379-83b4-686e0168b010 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1407 microversion: 2.20 time: 0.362219 Jul 12 03:55:57.813711 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 351/728] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:57 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:55:58.029783 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-403f7c98-9425-40b4-81d5-ee78b353b441 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:58.037965 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-403f7c98-9425-40b4-81d5-ee78b353b441 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1277 microversion: 2.1 time: 0.323213 Jul 12 03:55:58.038540 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 378/729] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:57 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:55:58.831021 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-260f0518-4d02-4287-9b3b-1bef0e4fb6a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:58.831709 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-260f0518-4d02-4287-9b3b-1bef0e4fb6a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:58.838851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-260f0518-4d02-4287-9b3b-1bef0e4fb6a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:58.839378 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-260f0518-4d02-4287-9b3b-1bef0e4fb6a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:58.840199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-260f0518-4d02-4287-9b3b-1bef0e4fb6a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:58.840638 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-260f0518-4d02-4287-9b3b-1bef0e4fb6a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:59.054971 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-100eb275-d968-4783-a524-372b48cc8697 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:55:59.055591 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-100eb275-d968-4783-a524-372b48cc8697 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:55:59.064809 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-100eb275-d968-4783-a524-372b48cc8697 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:59.065270 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-100eb275-d968-4783-a524-372b48cc8697 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:59.066073 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-100eb275-d968-4783-a524-372b48cc8697 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:59.066648 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-100eb275-d968-4783-a524-372b48cc8697 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:59.142081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-260f0518-4d02-4287-9b3b-1bef0e4fb6a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:59.153279 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-260f0518-4d02-4287-9b3b-1bef0e4fb6a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:59.154902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-260f0518-4d02-4287-9b3b-1bef0e4fb6a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:59.156309 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-260f0518-4d02-4287-9b3b-1bef0e4fb6a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1407 microversion: 2.20 time: 0.329304 Jul 12 03:55:59.156984 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 352/730] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:55:58 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:55:59.212679 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-100eb275-d968-4783-a524-372b48cc8697 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:55:59.221538 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-100eb275-d968-4783-a524-372b48cc8697 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1277 microversion: 2.1 time: 0.170413 Jul 12 03:55:59.222154 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 379/731] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:55:59 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:55:59.485529 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-7d83d9c4-5acc-4101-9b96-42f7e998664d req-74c09398-3c91-46b0-a614-e39895bb4555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63", "tag": "17836774-6562-4ed2-9a30-cc38e71017de"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:55:59.495263 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-7d83d9c4-5acc-4101-9b96-42f7e998664d req-74c09398-3c91-46b0-a614-e39895bb4555 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:55:59.495865 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-7d83d9c4-5acc-4101-9b96-42f7e998664d req-74c09398-3c91-46b0-a614-e39895bb4555 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:55:59.507728 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-7d83d9c4-5acc-4101-9b96-42f7e998664d req-74c09398-3c91-46b0-a614-e39895bb4555 service nova] Creating event network-changed:17836774-6562-4ed2-9a30-cc38e71017de for instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 on hv-cinder-84773 Jul 12 03:55:59.512736 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-7d83d9c4-5acc-4101-9b96-42f7e998664d req-74c09398-3c91-46b0-a614-e39895bb4555 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030983 Jul 12 03:55:59.513330 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 353/732] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:56:00.178620 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-287136e2-fa1a-4184-becd-6a1a645f3d39 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:00.179659 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-287136e2-fa1a-4184-becd-6a1a645f3d39 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:00.190626 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-287136e2-fa1a-4184-becd-6a1a645f3d39 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:00.191360 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-287136e2-fa1a-4184-becd-6a1a645f3d39 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:00.192673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-287136e2-fa1a-4184-becd-6a1a645f3d39 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:00.193382 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-287136e2-fa1a-4184-becd-6a1a645f3d39 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:00.239419 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2bad0dc4-608f-4024-8086-1711d1cc5350 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:00.239968 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-2bad0dc4-608f-4024-8086-1711d1cc5350 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:00.246473 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2bad0dc4-608f-4024-8086-1711d1cc5350 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:00.246913 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2bad0dc4-608f-4024-8086-1711d1cc5350 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:00.247645 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2bad0dc4-608f-4024-8086-1711d1cc5350 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:00.248127 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2bad0dc4-608f-4024-8086-1711d1cc5350 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:00.331661 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-287136e2-fa1a-4184-becd-6a1a645f3d39 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:00.340176 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-287136e2-fa1a-4184-becd-6a1a645f3d39 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:00.341706 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-287136e2-fa1a-4184-becd-6a1a645f3d39 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:00.343003 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-287136e2-fa1a-4184-becd-6a1a645f3d39 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1407 microversion: 2.20 time: 0.170856 Jul 12 03:56:00.343571 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 380/733] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:56:00 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:56:00.388783 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-2bad0dc4-608f-4024-8086-1711d1cc5350 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:00.401266 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-2bad0dc4-608f-4024-8086-1711d1cc5350 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1277 microversion: 2.1 time: 0.166255 Jul 12 03:56:00.401836 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 354/734] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:00 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:01.365749 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b2409260-2889-4806-ad58-0ef74e88800f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:01.366794 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b2409260-2889-4806-ad58-0ef74e88800f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:01.376845 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b2409260-2889-4806-ad58-0ef74e88800f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:01.377355 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b2409260-2889-4806-ad58-0ef74e88800f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:01.378096 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b2409260-2889-4806-ad58-0ef74e88800f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:01.378532 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b2409260-2889-4806-ad58-0ef74e88800f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:01.418478 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5cc62d90-3b3e-4266-a6e2-58870e838baa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:01.419117 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5cc62d90-3b3e-4266-a6e2-58870e838baa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:01.427102 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5cc62d90-3b3e-4266-a6e2-58870e838baa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:01.427569 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5cc62d90-3b3e-4266-a6e2-58870e838baa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:01.428356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5cc62d90-3b3e-4266-a6e2-58870e838baa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:01.428821 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5cc62d90-3b3e-4266-a6e2-58870e838baa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:01.509206 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b2409260-2889-4806-ad58-0ef74e88800f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:01.517542 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b2409260-2889-4806-ad58-0ef74e88800f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:01.519048 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b2409260-2889-4806-ad58-0ef74e88800f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:01.520234 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b2409260-2889-4806-ad58-0ef74e88800f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1407 microversion: 2.20 time: 0.161131 Jul 12 03:56:01.521163 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 381/735] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:56:01 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:56:01.563430 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5cc62d90-3b3e-4266-a6e2-58870e838baa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:01.570876 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5cc62d90-3b3e-4266-a6e2-58870e838baa tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1277 microversion: 2.1 time: 0.156296 Jul 12 03:56:01.571431 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 355/736] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:01 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:02.542519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f8bf80cb-30db-4180-95e2-180b52e019e8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:02.543532 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f8bf80cb-30db-4180-95e2-180b52e019e8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:02.554579 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f8bf80cb-30db-4180-95e2-180b52e019e8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:02.555283 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f8bf80cb-30db-4180-95e2-180b52e019e8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:02.556613 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f8bf80cb-30db-4180-95e2-180b52e019e8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:02.557336 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f8bf80cb-30db-4180-95e2-180b52e019e8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:02.587815 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8a9ad1d5-1ed2-4e29-8cd9-80530224e004 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:02.588402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8a9ad1d5-1ed2-4e29-8cd9-80530224e004 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:02.597181 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8a9ad1d5-1ed2-4e29-8cd9-80530224e004 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:02.597764 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8a9ad1d5-1ed2-4e29-8cd9-80530224e004 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:02.598813 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8a9ad1d5-1ed2-4e29-8cd9-80530224e004 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:02.599253 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8a9ad1d5-1ed2-4e29-8cd9-80530224e004 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:02.700422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f8bf80cb-30db-4180-95e2-180b52e019e8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:02.709077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f8bf80cb-30db-4180-95e2-180b52e019e8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:02.710576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f8bf80cb-30db-4180-95e2-180b52e019e8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:02.711704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f8bf80cb-30db-4180-95e2-180b52e019e8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1407 microversion: 2.20 time: 0.176122 Jul 12 03:56:02.712315 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 382/737] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:56:02 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:56:02.734248 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8a9ad1d5-1ed2-4e29-8cd9-80530224e004 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:02.741735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8a9ad1d5-1ed2-4e29-8cd9-80530224e004 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1277 microversion: 2.1 time: 0.157740 Jul 12 03:56:02.742303 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 356/738] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:02 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:03.729200 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-54ee2e07-991f-4bb5-b8dd-6deaa7988c74 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:03.730465 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-54ee2e07-991f-4bb5-b8dd-6deaa7988c74 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:03.741479 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-54ee2e07-991f-4bb5-b8dd-6deaa7988c74 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:03.741941 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-54ee2e07-991f-4bb5-b8dd-6deaa7988c74 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:03.742729 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-54ee2e07-991f-4bb5-b8dd-6deaa7988c74 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:03.743181 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-54ee2e07-991f-4bb5-b8dd-6deaa7988c74 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:03.758435 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-366809b0-3dff-4e29-9e30-93213070d443 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:03.759418 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-366809b0-3dff-4e29-9e30-93213070d443 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:03.766203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-366809b0-3dff-4e29-9e30-93213070d443 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:03.766700 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-366809b0-3dff-4e29-9e30-93213070d443 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:03.767565 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-366809b0-3dff-4e29-9e30-93213070d443 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:03.768273 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-366809b0-3dff-4e29-9e30-93213070d443 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:03.768450 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=4 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:56:03.911802 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-54ee2e07-991f-4bb5-b8dd-6deaa7988c74 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:03.919456 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-54ee2e07-991f-4bb5-b8dd-6deaa7988c74 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:03.921093 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-54ee2e07-991f-4bb5-b8dd-6deaa7988c74 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:03.922334 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-54ee2e07-991f-4bb5-b8dd-6deaa7988c74 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1407 microversion: 2.20 time: 0.196952 Jul 12 03:56:03.922918 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 383/739] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:56:03 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:56:03.927969 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1d766f14-48de-4c1c-ad34-86150e931942 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:03.928920 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1d766f14-48de-4c1c-ad34-86150e931942 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:03.935326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d766f14-48de-4c1c-ad34-86150e931942 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:03.936062 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d766f14-48de-4c1c-ad34-86150e931942 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:03.937056 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d766f14-48de-4c1c-ad34-86150e931942 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:03.937627 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d766f14-48de-4c1c-ad34-86150e931942 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:03.939379 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-366809b0-3dff-4e29-9e30-93213070d443 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:03.948709 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-366809b0-3dff-4e29-9e30-93213070d443 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.194062 Jul 12 03:56:03.949374 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 357/740] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:03 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:04.086073 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1d766f14-48de-4c1c-ad34-86150e931942 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:04.096808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1d766f14-48de-4c1c-ad34-86150e931942 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1594 microversion: 2.1 time: 0.172740 Jul 12 03:56:04.097351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 384/741] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:03 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1594 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:04.940529 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b19c15a3-7532-4029-b62e-a4269e2aa241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:04.941117 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b19c15a3-7532-4029-b62e-a4269e2aa241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:04.944823 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:56:04.949074 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b19c15a3-7532-4029-b62e-a4269e2aa241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:04.949520 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b19c15a3-7532-4029-b62e-a4269e2aa241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:04.950284 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b19c15a3-7532-4029-b62e-a4269e2aa241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:04.950714 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b19c15a3-7532-4029-b62e-a4269e2aa241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:04.966655 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c174167d-fbe2-44f9-ab50-286261c5dfa9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:04.967273 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c174167d-fbe2-44f9-ab50-286261c5dfa9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:04.976272 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c174167d-fbe2-44f9-ab50-286261c5dfa9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:04.976840 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c174167d-fbe2-44f9-ab50-286261c5dfa9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:04.977653 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c174167d-fbe2-44f9-ab50-286261c5dfa9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:04.978053 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c174167d-fbe2-44f9-ab50-286261c5dfa9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:05.049007 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:56:05.069237 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=6 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:56:05.095493 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b19c15a3-7532-4029-b62e-a4269e2aa241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:05.104514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b19c15a3-7532-4029-b62e-a4269e2aa241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:05.106525 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b19c15a3-7532-4029-b62e-a4269e2aa241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:05.107804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b19c15a3-7532-4029-b62e-a4269e2aa241 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1407 microversion: 2.20 time: 0.171342 Jul 12 03:56:05.108675 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 358/742] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:56:04 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:56:05.177440 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c174167d-fbe2-44f9-ab50-286261c5dfa9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:05.185507 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c174167d-fbe2-44f9-ab50-286261c5dfa9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.223363 Jul 12 03:56:05.191351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 385/743] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:04 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:05.231506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-54015fcc-6d62-4589-85f3-2388759f783d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:05.231994 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-54015fcc-6d62-4589-85f3-2388759f783d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:05.238190 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-54015fcc-6d62-4589-85f3-2388759f783d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:05.238641 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-54015fcc-6d62-4589-85f3-2388759f783d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:05.239382 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-54015fcc-6d62-4589-85f3-2388759f783d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:05.239810 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-54015fcc-6d62-4589-85f3-2388759f783d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:05.322049 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.objects.instance [None req-54015fcc-6d62-4589-85f3-2388759f783d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lazy-loading 'services' on Instance uuid e83ba0f3-55f9-4a38-9794-46bb9876f0d7 {{(pid=124435) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:56:05.401493 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-54015fcc-6d62-4589-85f3-2388759f783d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/os-volume_attachments/e5f574d6-d076-4aa5-a313-0af2bf5af642" status: 202 len: 0 microversion: 2.1 time: 0.291435 Jul 12 03:56:05.402321 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 359/744] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 03:56:05 2022] DELETE /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/os-volume_attachments/e5f574d6-d076-4aa5-a313-0af2bf5af642 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:56:05.884837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-dc4472d6-761d-4c4e-bd28-881a9e5c8b58 req-b1d1801b-86f2-4001-90f7-9a0493a575dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63", "name": "network-vif-plugged", "status": "completed", "tag": "17836774-6562-4ed2-9a30-cc38e71017de"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:56:05.888453 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=14 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:56:05.896229 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-dc4472d6-761d-4c4e-bd28-881a9e5c8b58 req-b1d1801b-86f2-4001-90f7-9a0493a575dd service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:05.896669 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-dc4472d6-761d-4c4e-bd28-881a9e5c8b58 req-b1d1801b-86f2-4001-90f7-9a0493a575dd service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:05.908476 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-dc4472d6-761d-4c4e-bd28-881a9e5c8b58 req-b1d1801b-86f2-4001-90f7-9a0493a575dd service nova] Creating event network-vif-plugged:17836774-6562-4ed2-9a30-cc38e71017de for instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 on hv-cinder-84773 Jul 12 03:56:05.913512 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-dc4472d6-761d-4c4e-bd28-881a9e5c8b58 req-b1d1801b-86f2-4001-90f7-9a0493a575dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032418 Jul 12 03:56:05.914276 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 386/745] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:56:06.128816 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5b30591b-28a7-461a-a61b-8b64fce6b73d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:06.130146 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5b30591b-28a7-461a-a61b-8b64fce6b73d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:06.150479 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5b30591b-28a7-461a-a61b-8b64fce6b73d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:06.150941 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5b30591b-28a7-461a-a61b-8b64fce6b73d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:06.151850 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5b30591b-28a7-461a-a61b-8b64fce6b73d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:06.152319 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5b30591b-28a7-461a-a61b-8b64fce6b73d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:06.156427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-54b50e2f-d831-433b-a907-04fd25e01ebb req-44c362af-0dd5-4008-979f-c2ed8f512996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc703cb-c9d3-4fce-a3af-2e7253cdb910", "tag": "05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:56:06.167221 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-54b50e2f-d831-433b-a907-04fd25e01ebb req-44c362af-0dd5-4008-979f-c2ed8f512996 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:06.168073 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-54b50e2f-d831-433b-a907-04fd25e01ebb req-44c362af-0dd5-4008-979f-c2ed8f512996 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:06.180206 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-54b50e2f-d831-433b-a907-04fd25e01ebb req-44c362af-0dd5-4008-979f-c2ed8f512996 service nova] Creating event network-changed:05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3 for instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 on hv-cinder-84773 Jul 12 03:56:06.186751 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-54b50e2f-d831-433b-a907-04fd25e01ebb req-44c362af-0dd5-4008-979f-c2ed8f512996 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035132 Jul 12 03:56:06.191211 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 387/746] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 03:56:06.205247 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-09e22627-29ae-4e96-b1c3-d5b9a8ec817a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:06.207178 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-09e22627-29ae-4e96-b1c3-d5b9a8ec817a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:06.217524 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-09e22627-29ae-4e96-b1c3-d5b9a8ec817a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:06.218398 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-09e22627-29ae-4e96-b1c3-d5b9a8ec817a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:06.219399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-09e22627-29ae-4e96-b1c3-d5b9a8ec817a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:06.220077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-09e22627-29ae-4e96-b1c3-d5b9a8ec817a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:06.383164 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-09e22627-29ae-4e96-b1c3-d5b9a8ec817a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:06.391928 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-09e22627-29ae-4e96-b1c3-d5b9a8ec817a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.193093 Jul 12 03:56:06.392542 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 388/747] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:06 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:56:06.521283 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5b30591b-28a7-461a-a61b-8b64fce6b73d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:06.531454 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5b30591b-28a7-461a-a61b-8b64fce6b73d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:06.532963 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5b30591b-28a7-461a-a61b-8b64fce6b73d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:06.536785 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5b30591b-28a7-461a-a61b-8b64fce6b73d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1407 microversion: 2.20 time: 0.413591 Jul 12 03:56:06.537506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 360/748] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:56:06 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:56:07.409796 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f8df50c8-b61a-4453-91c2-d00b16e4a8c9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:07.410439 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f8df50c8-b61a-4453-91c2-d00b16e4a8c9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:07.411114 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6843d98d-8c73-45c1-b582-18251f29bfa4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1099857249"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:56:07.411649 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6843d98d-8c73-45c1-b582-18251f29bfa4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:07.417120 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f8df50c8-b61a-4453-91c2-d00b16e4a8c9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:07.417584 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f8df50c8-b61a-4453-91c2-d00b16e4a8c9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:07.418470 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f8df50c8-b61a-4453-91c2-d00b16e4a8c9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:07.418595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6843d98d-8c73-45c1-b582-18251f29bfa4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:07.418944 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6843d98d-8c73-45c1-b582-18251f29bfa4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:07.419056 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f8df50c8-b61a-4453-91c2-d00b16e4a8c9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:07.419675 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6843d98d-8c73-45c1-b582-18251f29bfa4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:07.420168 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6843d98d-8c73-45c1-b582-18251f29bfa4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:07.549985 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.network.security_group_api [None req-6843d98d-8c73-45c1-b582-18251f29bfa4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Adding security group aedc2799-e553-47ba-9ab4-519912c8e3a2 to port 05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3 Jul 12 03:56:07.554033 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f8df50c8-b61a-4453-91c2-d00b16e4a8c9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:07.562243 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f8df50c8-b61a-4453-91c2-d00b16e4a8c9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.156702 Jul 12 03:56:07.571270 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 389/749] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:07 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:07.576562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c9a37a2b-04cc-49ce-8852-44b4d1d4a640 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:07.577808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c9a37a2b-04cc-49ce-8852-44b4d1d4a640 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:07.584820 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c9a37a2b-04cc-49ce-8852-44b4d1d4a640 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:07.585453 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c9a37a2b-04cc-49ce-8852-44b4d1d4a640 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:07.586390 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c9a37a2b-04cc-49ce-8852-44b4d1d4a640 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:07.587138 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c9a37a2b-04cc-49ce-8852-44b4d1d4a640 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:07.615592 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:56:07.732708 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c9a37a2b-04cc-49ce-8852-44b4d1d4a640 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:07.741112 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c9a37a2b-04cc-49ce-8852-44b4d1d4a640 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:07.742748 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c9a37a2b-04cc-49ce-8852-44b4d1d4a640 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:07.743899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c9a37a2b-04cc-49ce-8852-44b4d1d4a640 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1407 microversion: 2.20 time: 0.171407 Jul 12 03:56:07.744496 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 390/750] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:56:07 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:56:07.749528 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7c0f0568-c5c8-492c-87ef-ab5b41680056 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:56:07.755393 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c0f0568-c5c8-492c-87ef-ab5b41680056 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:07.755850 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7c0f0568-c5c8-492c-87ef-ab5b41680056 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:07.817648 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7c0f0568-c5c8-492c-87ef-ab5b41680056 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Going to try to stop instance {{(pid=124434) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 03:56:07.861826 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7c0f0568-c5c8-492c-87ef-ab5b41680056 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "POST /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/action" status: 202 len: 0 microversion: 2.1 time: 0.115600 Jul 12 03:56:07.862426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 391/751] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 03:56:07 2022] POST /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:56:07.871119 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-71f2f015-6675-43c7-812a-a5e6eacafb39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:07.871827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-71f2f015-6675-43c7-812a-a5e6eacafb39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:07.878717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-71f2f015-6675-43c7-812a-a5e6eacafb39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:07.879077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-71f2f015-6675-43c7-812a-a5e6eacafb39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:07.879890 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-71f2f015-6675-43c7-812a-a5e6eacafb39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:07.880468 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-71f2f015-6675-43c7-812a-a5e6eacafb39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:08.032289 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-71f2f015-6675-43c7-812a-a5e6eacafb39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:08.039940 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-71f2f015-6675-43c7-812a-a5e6eacafb39 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1678 microversion: 2.1 time: 0.173141 Jul 12 03:56:08.041418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 392/752] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:07 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:56:08.064974 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6843d98d-8c73-45c1-b582-18251f29bfa4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "POST /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/action" status: 202 len: 0 microversion: 2.1 time: 0.658526 Jul 12 03:56:08.069666 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 361/753] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 03:56:07 2022] POST /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:56:08.074690 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-fc4e3fb5-542f-443e-b5fa-2f3bb8815e3e req-81cf8e40-7519-44db-9b54-1c456a511087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc703cb-c9d3-4fce-a3af-2e7253cdb910", "tag": "05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:56:08.078390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-85497007-c793-4203-beb5-fe229f298891 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:08.078991 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-85497007-c793-4203-beb5-fe229f298891 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:08.087802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-85497007-c793-4203-beb5-fe229f298891 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:08.088284 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-85497007-c793-4203-beb5-fe229f298891 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:08.089241 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-85497007-c793-4203-beb5-fe229f298891 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:08.089808 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-85497007-c793-4203-beb5-fe229f298891 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:08.091375 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-fc4e3fb5-542f-443e-b5fa-2f3bb8815e3e req-81cf8e40-7519-44db-9b54-1c456a511087 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:08.091827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-fc4e3fb5-542f-443e-b5fa-2f3bb8815e3e req-81cf8e40-7519-44db-9b54-1c456a511087 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:08.104650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-fc4e3fb5-542f-443e-b5fa-2f3bb8815e3e req-81cf8e40-7519-44db-9b54-1c456a511087 service nova] Creating event network-changed:05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3 for instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 on hv-cinder-84773 Jul 12 03:56:08.110805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-fc4e3fb5-542f-443e-b5fa-2f3bb8815e3e req-81cf8e40-7519-44db-9b54-1c456a511087 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039734 Jul 12 03:56:08.111605 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 393/754] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:56:08.333880 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-85497007-c793-4203-beb5-fe229f298891 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:08.342925 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-85497007-c793-4203-beb5-fe229f298891 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1641 microversion: 2.1 time: 0.269195 Jul 12 03:56:08.343429 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 362/755] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:08 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1641 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:56:08.580265 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-69446fc2-789c-4f4a-a89f-70d0566549ff tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:08.580923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-69446fc2-789c-4f4a-a89f-70d0566549ff tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:08.587578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-69446fc2-789c-4f4a-a89f-70d0566549ff tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:08.588043 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-69446fc2-789c-4f4a-a89f-70d0566549ff tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:08.588817 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-69446fc2-789c-4f4a-a89f-70d0566549ff tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:08.589249 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-69446fc2-789c-4f4a-a89f-70d0566549ff tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:08.724961 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-69446fc2-789c-4f4a-a89f-70d0566549ff tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:08.732920 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-69446fc2-789c-4f4a-a89f-70d0566549ff tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.157588 Jul 12 03:56:08.733539 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 394/756] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:08 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:08.762028 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-987b3197-5630-4753-a33e-b92341220d85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:08.762636 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-987b3197-5630-4753-a33e-b92341220d85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:08.769563 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-987b3197-5630-4753-a33e-b92341220d85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:08.770006 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-987b3197-5630-4753-a33e-b92341220d85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:08.771125 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-987b3197-5630-4753-a33e-b92341220d85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:08.771752 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-987b3197-5630-4753-a33e-b92341220d85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:08.912485 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-987b3197-5630-4753-a33e-b92341220d85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:08.921012 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-987b3197-5630-4753-a33e-b92341220d85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:08.922570 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-987b3197-5630-4753-a33e-b92341220d85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:08.923769 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-987b3197-5630-4753-a33e-b92341220d85 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1600 microversion: 2.20 time: 0.165701 Jul 12 03:56:08.924440 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 363/757] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:56:08 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:56:08.941250 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-74713ff3-c49c-4265-9b44-ec89fb949ebc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:08.941748 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-74713ff3-c49c-4265-9b44-ec89fb949ebc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:08.948226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-74713ff3-c49c-4265-9b44-ec89fb949ebc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:08.948700 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-74713ff3-c49c-4265-9b44-ec89fb949ebc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:08.949467 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-74713ff3-c49c-4265-9b44-ec89fb949ebc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:08.949901 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-74713ff3-c49c-4265-9b44-ec89fb949ebc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:09.032480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-74713ff3-c49c-4265-9b44-ec89fb949ebc tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094969 Jul 12 03:56:09.033210 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 395/758] 10.222.0.20 () {60 vars in 1315 bytes} [Tue Jul 12 03:56:08 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:56:09.057546 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1a07529b-b368-4ad3-9828-4247750cc1f1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:09.058176 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1a07529b-b368-4ad3-9828-4247750cc1f1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:09.064468 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1a07529b-b368-4ad3-9828-4247750cc1f1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:09.064910 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1a07529b-b368-4ad3-9828-4247750cc1f1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:09.065668 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1a07529b-b368-4ad3-9828-4247750cc1f1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:09.066097 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1a07529b-b368-4ad3-9828-4247750cc1f1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:09.406692 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1a07529b-b368-4ad3-9828-4247750cc1f1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:09.415609 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1a07529b-b368-4ad3-9828-4247750cc1f1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1678 microversion: 2.1 time: 0.361901 Jul 12 03:56:09.416350 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 364/759] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:09 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1678 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:09.750528 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-fb8ea772-7e30-45a4-bc61-82ae1140d152 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:09.751077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-fb8ea772-7e30-45a4-bc61-82ae1140d152 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:09.757829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb8ea772-7e30-45a4-bc61-82ae1140d152 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:09.758286 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb8ea772-7e30-45a4-bc61-82ae1140d152 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:09.759095 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb8ea772-7e30-45a4-bc61-82ae1140d152 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:09.759535 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb8ea772-7e30-45a4-bc61-82ae1140d152 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:09.900682 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-fb8ea772-7e30-45a4-bc61-82ae1140d152 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:09.908606 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-fb8ea772-7e30-45a4-bc61-82ae1140d152 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.162619 Jul 12 03:56:09.909154 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 396/760] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:09 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:10.344140 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-e57fc123-d7e1-4769-9c04-a4de5b3c077f req-e7a6bf10-3159-40d9-95f0-9495ada2272c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63", "tag": "17836774-6562-4ed2-9a30-cc38e71017de"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:56:10.353199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-e57fc123-d7e1-4769-9c04-a4de5b3c077f req-e7a6bf10-3159-40d9-95f0-9495ada2272c service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:10.353643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-e57fc123-d7e1-4769-9c04-a4de5b3c077f req-e7a6bf10-3159-40d9-95f0-9495ada2272c service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:10.366191 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-e57fc123-d7e1-4769-9c04-a4de5b3c077f req-e7a6bf10-3159-40d9-95f0-9495ada2272c service nova] Creating event network-changed:17836774-6562-4ed2-9a30-cc38e71017de for instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 on hv-cinder-84773 Jul 12 03:56:10.371658 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-e57fc123-d7e1-4769-9c04-a4de5b3c077f req-e7a6bf10-3159-40d9-95f0-9495ada2272c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031370 Jul 12 03:56:10.372392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 365/761] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:56:10.432850 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-46e45a8d-faf3-4ae7-92c5-15ccaa130eb9 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:10.433460 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-46e45a8d-faf3-4ae7-92c5-15ccaa130eb9 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:10.440054 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-46e45a8d-faf3-4ae7-92c5-15ccaa130eb9 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:10.440534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-46e45a8d-faf3-4ae7-92c5-15ccaa130eb9 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:10.441298 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-46e45a8d-faf3-4ae7-92c5-15ccaa130eb9 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:10.441732 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-46e45a8d-faf3-4ae7-92c5-15ccaa130eb9 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:10.574094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-46e45a8d-faf3-4ae7-92c5-15ccaa130eb9 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:10.582875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-46e45a8d-faf3-4ae7-92c5-15ccaa130eb9 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1678 microversion: 2.1 time: 0.153992 Jul 12 03:56:10.583471 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 397/762] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:10 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:10.926929 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3694e3a8-8f31-40f0-87e6-58c2768a3dce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:10.927630 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3694e3a8-8f31-40f0-87e6-58c2768a3dce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:10.934461 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3694e3a8-8f31-40f0-87e6-58c2768a3dce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:10.934918 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3694e3a8-8f31-40f0-87e6-58c2768a3dce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:10.935741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3694e3a8-8f31-40f0-87e6-58c2768a3dce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:10.936205 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3694e3a8-8f31-40f0-87e6-58c2768a3dce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:11.074518 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3694e3a8-8f31-40f0-87e6-58c2768a3dce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:11.082406 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3694e3a8-8f31-40f0-87e6-58c2768a3dce tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.159805 Jul 12 03:56:11.083086 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 366/763] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:10 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:11.600323 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-66b1ef6d-b0b4-460e-8531-81e08ed112b8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:11.600970 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-66b1ef6d-b0b4-460e-8531-81e08ed112b8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:11.607727 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66b1ef6d-b0b4-460e-8531-81e08ed112b8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:11.608249 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66b1ef6d-b0b4-460e-8531-81e08ed112b8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:11.609033 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66b1ef6d-b0b4-460e-8531-81e08ed112b8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:11.609469 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66b1ef6d-b0b4-460e-8531-81e08ed112b8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:11.738921 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-66b1ef6d-b0b4-460e-8531-81e08ed112b8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:11.746562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-66b1ef6d-b0b4-460e-8531-81e08ed112b8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1678 microversion: 2.1 time: 0.150154 Jul 12 03:56:11.747104 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 398/764] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:11 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:12.104056 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f3fa89fd-1e98-4dc0-9b80-98d0c3ab58a8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:12.105055 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f3fa89fd-1e98-4dc0-9b80-98d0c3ab58a8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:12.115313 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f3fa89fd-1e98-4dc0-9b80-98d0c3ab58a8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:12.115764 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f3fa89fd-1e98-4dc0-9b80-98d0c3ab58a8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:12.116645 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f3fa89fd-1e98-4dc0-9b80-98d0c3ab58a8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:12.117077 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f3fa89fd-1e98-4dc0-9b80-98d0c3ab58a8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:12.122895 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:56:12.255030 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f3fa89fd-1e98-4dc0-9b80-98d0c3ab58a8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:12.262662 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f3fa89fd-1e98-4dc0-9b80-98d0c3ab58a8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.165524 Jul 12 03:56:12.263203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 367/765] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:12 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:12.767727 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d0e74fa2-2a98-4393-a929-74af0ed562d5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:12.768678 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d0e74fa2-2a98-4393-a929-74af0ed562d5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:12.781352 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d0e74fa2-2a98-4393-a929-74af0ed562d5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:12.782147 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d0e74fa2-2a98-4393-a929-74af0ed562d5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:12.783504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d0e74fa2-2a98-4393-a929-74af0ed562d5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:12.784203 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d0e74fa2-2a98-4393-a929-74af0ed562d5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:12.916276 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d0e74fa2-2a98-4393-a929-74af0ed562d5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:12.923912 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d0e74fa2-2a98-4393-a929-74af0ed562d5 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1678 microversion: 2.1 time: 0.162404 Jul 12 03:56:12.924528 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 399/766] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:12 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:13.284297 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-cae6136b-ae91-4212-8464-60874d7c218d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:13.285167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-cae6136b-ae91-4212-8464-60874d7c218d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:13.296428 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cae6136b-ae91-4212-8464-60874d7c218d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:13.297107 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cae6136b-ae91-4212-8464-60874d7c218d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:13.298369 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cae6136b-ae91-4212-8464-60874d7c218d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:13.299067 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cae6136b-ae91-4212-8464-60874d7c218d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:13.441093 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-cae6136b-ae91-4212-8464-60874d7c218d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:13.450577 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-cae6136b-ae91-4212-8464-60874d7c218d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.172771 Jul 12 03:56:13.451197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 368/767] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:13 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:13.946795 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f42a1573-2bd8-4f23-8a5b-ced5d74d6da2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:13.948050 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f42a1573-2bd8-4f23-8a5b-ced5d74d6da2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:13.955152 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f42a1573-2bd8-4f23-8a5b-ced5d74d6da2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:13.955604 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f42a1573-2bd8-4f23-8a5b-ced5d74d6da2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:13.956430 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f42a1573-2bd8-4f23-8a5b-ced5d74d6da2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:13.957058 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f42a1573-2bd8-4f23-8a5b-ced5d74d6da2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:14.089571 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f42a1573-2bd8-4f23-8a5b-ced5d74d6da2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:14.097832 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f42a1573-2bd8-4f23-8a5b-ced5d74d6da2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1678 microversion: 2.1 time: 0.154912 Jul 12 03:56:14.098410 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 400/768] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:13 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:14.470998 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5b22b302-b383-40f3-afdd-0c54b13a647f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:14.471567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5b22b302-b383-40f3-afdd-0c54b13a647f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:14.478534 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5b22b302-b383-40f3-afdd-0c54b13a647f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:14.478982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5b22b302-b383-40f3-afdd-0c54b13a647f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:14.479751 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5b22b302-b383-40f3-afdd-0c54b13a647f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:14.480193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5b22b302-b383-40f3-afdd-0c54b13a647f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:14.630601 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5b22b302-b383-40f3-afdd-0c54b13a647f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:14.638267 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5b22b302-b383-40f3-afdd-0c54b13a647f tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.174000 Jul 12 03:56:14.638953 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 369/769] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:14 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:15.124131 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-87b013a7-c7f9-4c47-9a85-f471dc53ba98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:15.125126 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-87b013a7-c7f9-4c47-9a85-f471dc53ba98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:15.136304 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-87b013a7-c7f9-4c47-9a85-f471dc53ba98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:15.137054 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-87b013a7-c7f9-4c47-9a85-f471dc53ba98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:15.138320 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-87b013a7-c7f9-4c47-9a85-f471dc53ba98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:15.139086 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-87b013a7-c7f9-4c47-9a85-f471dc53ba98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:15.273505 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-87b013a7-c7f9-4c47-9a85-f471dc53ba98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:15.281757 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-87b013a7-c7f9-4c47-9a85-f471dc53ba98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1678 microversion: 2.1 time: 0.164392 Jul 12 03:56:15.282332 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 401/770] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:15 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:15.658913 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ab83b0a7-1b2a-4a8d-9f42-2b425e2d6598 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:15.659923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ab83b0a7-1b2a-4a8d-9f42-2b425e2d6598 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:15.671199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ab83b0a7-1b2a-4a8d-9f42-2b425e2d6598 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:15.671988 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ab83b0a7-1b2a-4a8d-9f42-2b425e2d6598 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:15.673303 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ab83b0a7-1b2a-4a8d-9f42-2b425e2d6598 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:15.674069 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ab83b0a7-1b2a-4a8d-9f42-2b425e2d6598 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:15.824315 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ab83b0a7-1b2a-4a8d-9f42-2b425e2d6598 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:15.832431 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ab83b0a7-1b2a-4a8d-9f42-2b425e2d6598 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.179956 Jul 12 03:56:15.832931 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 370/771] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:15 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:15.960936 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-efccbcea-d66a-46d7-b132-d455393709e8 req-67789c33-2b72-425c-9866-d85681caa0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235a37d4-1517-4ea0-ab89-8b63a0413983", "name": "network-vif-plugged", "status": "completed", "tag": "a2e41b8a-4d2a-40b4-904c-82ef5d61e3b3"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:56:15.969878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-efccbcea-d66a-46d7-b132-d455393709e8 req-67789c33-2b72-425c-9866-d85681caa0d2 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:15.970332 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-efccbcea-d66a-46d7-b132-d455393709e8 req-67789c33-2b72-425c-9866-d85681caa0d2 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:15.981796 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-efccbcea-d66a-46d7-b132-d455393709e8 req-67789c33-2b72-425c-9866-d85681caa0d2 service nova] Creating event network-vif-plugged:a2e41b8a-4d2a-40b4-904c-82ef5d61e3b3 for instance 235a37d4-1517-4ea0-ab89-8b63a0413983 on hv-cinder-84773 Jul 12 03:56:15.986557 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-efccbcea-d66a-46d7-b132-d455393709e8 req-67789c33-2b72-425c-9866-d85681caa0d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029456 Jul 12 03:56:15.987150 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 402/772] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:56:16.299201 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-39605068-c407-4763-a3b3-d654ec784aaf tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:16.299799 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-39605068-c407-4763-a3b3-d654ec784aaf tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:16.306682 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-39605068-c407-4763-a3b3-d654ec784aaf tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:16.307163 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-39605068-c407-4763-a3b3-d654ec784aaf tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:16.307920 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-39605068-c407-4763-a3b3-d654ec784aaf tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:16.308386 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-39605068-c407-4763-a3b3-d654ec784aaf tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:16.467107 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-39605068-c407-4763-a3b3-d654ec784aaf tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:16.475222 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-39605068-c407-4763-a3b3-d654ec784aaf tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1678 microversion: 2.1 time: 0.180027 Jul 12 03:56:16.475797 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 371/773] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:16 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:16.850576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2ca5dd68-0c1a-4567-abc7-d7505e815d9b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:16.851308 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2ca5dd68-0c1a-4567-abc7-d7505e815d9b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:16.857979 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2ca5dd68-0c1a-4567-abc7-d7505e815d9b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:16.858454 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2ca5dd68-0c1a-4567-abc7-d7505e815d9b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:16.859205 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2ca5dd68-0c1a-4567-abc7-d7505e815d9b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:16.859633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2ca5dd68-0c1a-4567-abc7-d7505e815d9b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:16.997226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-2ca5dd68-0c1a-4567-abc7-d7505e815d9b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:17.005141 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2ca5dd68-0c1a-4567-abc7-d7505e815d9b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.159463 Jul 12 03:56:17.005716 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 403/774] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:16 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:17.496104 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fbe69b9e-e758-4a11-bad0-e84b69d0cd37 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:17.497124 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-fbe69b9e-e758-4a11-bad0-e84b69d0cd37 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:17.506306 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fbe69b9e-e758-4a11-bad0-e84b69d0cd37 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:17.506751 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fbe69b9e-e758-4a11-bad0-e84b69d0cd37 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:17.507525 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fbe69b9e-e758-4a11-bad0-e84b69d0cd37 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:17.507948 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fbe69b9e-e758-4a11-bad0-e84b69d0cd37 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:17.649695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-fbe69b9e-e758-4a11-bad0-e84b69d0cd37 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:17.657591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-fbe69b9e-e758-4a11-bad0-e84b69d0cd37 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1678 microversion: 2.1 time: 0.167946 Jul 12 03:56:17.658208 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 372/775] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:17 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:18.031379 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-77dd6858-8e28-4abe-8e6c-69b71cf2bee8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:18.032468 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-77dd6858-8e28-4abe-8e6c-69b71cf2bee8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:18.044500 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-77dd6858-8e28-4abe-8e6c-69b71cf2bee8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:18.045254 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-77dd6858-8e28-4abe-8e6c-69b71cf2bee8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:18.046510 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-77dd6858-8e28-4abe-8e6c-69b71cf2bee8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:18.047234 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-77dd6858-8e28-4abe-8e6c-69b71cf2bee8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:18.193814 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-77dd6858-8e28-4abe-8e6c-69b71cf2bee8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:18.202073 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-77dd6858-8e28-4abe-8e6c-69b71cf2bee8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1265 microversion: 2.1 time: 0.177243 Jul 12 03:56:18.202654 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 404/776] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:18 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:18.677120 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5c9db2d1-a290-43dc-b132-8ec03cd0fc97 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:18.677818 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5c9db2d1-a290-43dc-b132-8ec03cd0fc97 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:18.684189 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5c9db2d1-a290-43dc-b132-8ec03cd0fc97 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:18.684635 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5c9db2d1-a290-43dc-b132-8ec03cd0fc97 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:18.685397 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5c9db2d1-a290-43dc-b132-8ec03cd0fc97 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:18.685828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5c9db2d1-a290-43dc-b132-8ec03cd0fc97 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:19.075230 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5c9db2d1-a290-43dc-b132-8ec03cd0fc97 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:19.082884 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5c9db2d1-a290-43dc-b132-8ec03cd0fc97 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1655 microversion: 2.1 time: 0.411910 Jul 12 03:56:19.083450 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 373/777] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:18 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1655 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:19.099650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e40ba1bd-6f17-4e92-8330-ac204de9bd66 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:56:19.106490 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e40ba1bd-6f17-4e92-8330-ac204de9bd66 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:19.106945 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e40ba1bd-6f17-4e92-8330-ac204de9bd66 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:19.129822 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e40ba1bd-6f17-4e92-8330-ac204de9bd66 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Going to try to start instance {{(pid=124434) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 03:56:19.174184 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e40ba1bd-6f17-4e92-8330-ac204de9bd66 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "POST /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/action" status: 202 len: 0 microversion: 2.1 time: 0.078351 Jul 12 03:56:19.174796 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 405/778] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 03:56:19 2022] POST /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:56:19.182949 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f6f62a15-8258-40b4-8165-c3b5c3d82f32 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:19.183563 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f6f62a15-8258-40b4-8165-c3b5c3d82f32 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:19.190104 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f6f62a15-8258-40b4-8165-c3b5c3d82f32 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:19.190737 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f6f62a15-8258-40b4-8165-c3b5c3d82f32 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:19.191683 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f6f62a15-8258-40b4-8165-c3b5c3d82f32 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:19.192235 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f6f62a15-8258-40b4-8165-c3b5c3d82f32 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:19.219588 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-96f02306-8c94-4e9f-b07a-bf7417e4b468 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:19.220212 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-96f02306-8c94-4e9f-b07a-bf7417e4b468 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:19.226788 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-96f02306-8c94-4e9f-b07a-bf7417e4b468 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:19.227478 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-96f02306-8c94-4e9f-b07a-bf7417e4b468 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:19.228278 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-96f02306-8c94-4e9f-b07a-bf7417e4b468 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:19.228923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-96f02306-8c94-4e9f-b07a-bf7417e4b468 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:19.324212 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f6f62a15-8258-40b4-8165-c3b5c3d82f32 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:19.332601 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f6f62a15-8258-40b4-8165-c3b5c3d82f32 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1664 microversion: 2.1 time: 0.153396 Jul 12 03:56:19.333409 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 374/779] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:19 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:19.369834 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-96f02306-8c94-4e9f-b07a-bf7417e4b468 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:19.373769 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:56:19.378729 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-96f02306-8c94-4e9f-b07a-bf7417e4b468 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1453 microversion: 2.1 time: 0.163586 Jul 12 03:56:19.379321 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 406/780] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:19 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:19.394902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d3ecf294-8c37-4672-a12c-a929bfa607a1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:19.395512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d3ecf294-8c37-4672-a12c-a929bfa607a1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:19.402264 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d3ecf294-8c37-4672-a12c-a929bfa607a1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:19.402714 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d3ecf294-8c37-4672-a12c-a929bfa607a1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:19.403481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d3ecf294-8c37-4672-a12c-a929bfa607a1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:19.403916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d3ecf294-8c37-4672-a12c-a929bfa607a1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:19.596790 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d3ecf294-8c37-4672-a12c-a929bfa607a1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:19.604808 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d3ecf294-8c37-4672-a12c-a929bfa607a1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1453 microversion: 2.1 time: 0.213885 Jul 12 03:56:19.605604 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 375/781] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:19 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1453 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:20.349850 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-46fe5a09-ec6b-42aa-9708-feb90a07a10c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:20.350539 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-46fe5a09-ec6b-42aa-9708-feb90a07a10c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:20.358296 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-46fe5a09-ec6b-42aa-9708-feb90a07a10c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:20.358745 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-46fe5a09-ec6b-42aa-9708-feb90a07a10c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:20.359502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-46fe5a09-ec6b-42aa-9708-feb90a07a10c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:20.359960 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-46fe5a09-ec6b-42aa-9708-feb90a07a10c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:20.591856 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-46fe5a09-ec6b-42aa-9708-feb90a07a10c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:20.599516 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-46fe5a09-ec6b-42aa-9708-feb90a07a10c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1664 microversion: 2.1 time: 0.254024 Jul 12 03:56:20.600374 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 407/782] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:20 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1664 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:21.321665 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-2ff53958-88ee-4034-8c84-a77c60f12d09 req-a8d0c441-0d53-473a-bdf8-cd784464e13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "235a37d4-1517-4ea0-ab89-8b63a0413983", "tag": "a2e41b8a-4d2a-40b4-904c-82ef5d61e3b3"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:56:21.330601 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-2ff53958-88ee-4034-8c84-a77c60f12d09 req-a8d0c441-0d53-473a-bdf8-cd784464e13c service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:21.331286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-2ff53958-88ee-4034-8c84-a77c60f12d09 req-a8d0c441-0d53-473a-bdf8-cd784464e13c service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:21.343499 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-2ff53958-88ee-4034-8c84-a77c60f12d09 req-a8d0c441-0d53-473a-bdf8-cd784464e13c service nova] Creating event network-changed:a2e41b8a-4d2a-40b4-904c-82ef5d61e3b3 for instance 235a37d4-1517-4ea0-ab89-8b63a0413983 on hv-cinder-84773 Jul 12 03:56:21.349010 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-2ff53958-88ee-4034-8c84-a77c60f12d09 req-a8d0c441-0d53-473a-bdf8-cd784464e13c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031018 Jul 12 03:56:21.350372 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 376/783] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:56:21.617195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-03379910-2572-4fb1-9fdf-c8b2bc51bd5a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:21.617872 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-03379910-2572-4fb1-9fdf-c8b2bc51bd5a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:21.625456 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-03379910-2572-4fb1-9fdf-c8b2bc51bd5a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:21.626580 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-03379910-2572-4fb1-9fdf-c8b2bc51bd5a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:21.627329 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-03379910-2572-4fb1-9fdf-c8b2bc51bd5a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:21.627957 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-03379910-2572-4fb1-9fdf-c8b2bc51bd5a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:21.760707 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-03379910-2572-4fb1-9fdf-c8b2bc51bd5a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:21.768604 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-03379910-2572-4fb1-9fdf-c8b2bc51bd5a tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1668 microversion: 2.1 time: 0.155372 Jul 12 03:56:21.769477 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 408/784] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:21 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:54.905820 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=37 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:56:54.906606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=55 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:56:54.911558 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8bf607aa-3fcb-4659-9b75-21c69dfec46f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:54.912192 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8bf607aa-3fcb-4659-9b75-21c69dfec46f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:54.920222 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8bf607aa-3fcb-4659-9b75-21c69dfec46f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:54.920882 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8bf607aa-3fcb-4659-9b75-21c69dfec46f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:54.921942 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8bf607aa-3fcb-4659-9b75-21c69dfec46f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:54.922391 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8bf607aa-3fcb-4659-9b75-21c69dfec46f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:55.006337 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.objects.instance [None req-8bf607aa-3fcb-4659-9b75-21c69dfec46f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lazy-loading 'services' on Instance uuid 82e3bc04-35b0-412b-b8d6-65165bc79e60 {{(pid=124435) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:56:55.086272 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8bf607aa-3fcb-4659-9b75-21c69dfec46f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "DELETE /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-volume_attachments/0875ffcb-cea6-42fa-9d27-e78ae883f412" status: 202 len: 0 microversion: 2.1 time: 0.183143 Jul 12 03:56:55.086960 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 377/785] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 03:56:54 2022] DELETE /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-volume_attachments/0875ffcb-cea6-42fa-9d27-e78ae883f412 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:56:55.095625 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6b3e7e59-7073-40c3-9d9a-041d1db420e3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:55.096625 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-6b3e7e59-7073-40c3-9d9a-041d1db420e3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:55.099002 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:56:55.099797 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=12 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:56:55.105302 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6b3e7e59-7073-40c3-9d9a-041d1db420e3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:55.105821 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6b3e7e59-7073-40c3-9d9a-041d1db420e3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:55.106783 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6b3e7e59-7073-40c3-9d9a-041d1db420e3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:55.107214 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6b3e7e59-7073-40c3-9d9a-041d1db420e3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:55.146065 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-6b3e7e59-7073-40c3-9d9a-041d1db420e3 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054117 Jul 12 03:56:55.146799 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 409/786] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 03:56:55 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:56:56.162653 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e79ba73d-7ec8-407f-902f-164fd973478c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:56.163989 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e79ba73d-7ec8-407f-902f-164fd973478c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:56.175155 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e79ba73d-7ec8-407f-902f-164fd973478c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:56.175622 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e79ba73d-7ec8-407f-902f-164fd973478c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:56.176450 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e79ba73d-7ec8-407f-902f-164fd973478c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:56.176876 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e79ba73d-7ec8-407f-902f-164fd973478c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:56.211951 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e79ba73d-7ec8-407f-902f-164fd973478c tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055258 Jul 12 03:56:56.212920 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 378/787] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 03:56:56 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 03:56:56.297665 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8d2211a2-6b10-4895-858c-151bf04ead23 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:56.298208 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8d2211a2-6b10-4895-858c-151bf04ead23 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:56.305127 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8d2211a2-6b10-4895-858c-151bf04ead23 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:56.305571 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8d2211a2-6b10-4895-858c-151bf04ead23 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:56.306331 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8d2211a2-6b10-4895-858c-151bf04ead23 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:56.306752 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8d2211a2-6b10-4895-858c-151bf04ead23 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:56.332161 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8d2211a2-6b10-4895-858c-151bf04ead23 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Going to try to terminate instance {{(pid=124434) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:56:56.414850 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8d2211a2-6b10-4895-858c-151bf04ead23 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "DELETE /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 204 len: 0 microversion: 2.1 time: 0.120785 Jul 12 03:56:56.415498 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 410/788] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:56:56 2022] DELETE /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:56:56.423777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3324bb1d-367d-4034-b282-371494f7a81d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:56.424431 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3324bb1d-367d-4034-b282-371494f7a81d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:56.430553 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3324bb1d-367d-4034-b282-371494f7a81d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:56.431002 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3324bb1d-367d-4034-b282-371494f7a81d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:56.431794 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3324bb1d-367d-4034-b282-371494f7a81d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:56.432237 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3324bb1d-367d-4034-b282-371494f7a81d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:56.575639 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3324bb1d-367d-4034-b282-371494f7a81d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:56.583543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3324bb1d-367d-4034-b282-371494f7a81d tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1689 microversion: 2.1 time: 0.163622 Jul 12 03:56:56.584123 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 379/789] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:56 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:57.606163 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f131d18e-b5c0-42a1-a2cd-ce92e373271b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:57.607400 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f131d18e-b5c0-42a1-a2cd-ce92e373271b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:57.618328 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f131d18e-b5c0-42a1-a2cd-ce92e373271b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:57.619030 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f131d18e-b5c0-42a1-a2cd-ce92e373271b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:57.620497 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f131d18e-b5c0-42a1-a2cd-ce92e373271b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:57.620936 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f131d18e-b5c0-42a1-a2cd-ce92e373271b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:57.759577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f131d18e-b5c0-42a1-a2cd-ce92e373271b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:57.767980 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f131d18e-b5c0-42a1-a2cd-ce92e373271b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1689 microversion: 2.1 time: 0.169082 Jul 12 03:56:57.768599 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 411/790] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:57 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:58.790360 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-47de919b-0fb1-4d7b-aa64-557114c860af tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:58.791299 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-47de919b-0fb1-4d7b-aa64-557114c860af tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:58.798720 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-47de919b-0fb1-4d7b-aa64-557114c860af tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:58.799166 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-47de919b-0fb1-4d7b-aa64-557114c860af tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:58.799962 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-47de919b-0fb1-4d7b-aa64-557114c860af tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:58.800429 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-47de919b-0fb1-4d7b-aa64-557114c860af tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:58.933440 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-47de919b-0fb1-4d7b-aa64-557114c860af tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:56:58.941345 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-47de919b-0fb1-4d7b-aa64-557114c860af tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1689 microversion: 2.1 time: 0.157929 Jul 12 03:56:58.941922 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 380/791] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:58 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:56:59.963398 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-41491963-dee1-4229-9b14-b937235f76a4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:56:59.964400 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-41491963-dee1-4229-9b14-b937235f76a4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:56:59.971833 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-41491963-dee1-4229-9b14-b937235f76a4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:59.972292 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-41491963-dee1-4229-9b14-b937235f76a4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:56:59.973064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-41491963-dee1-4229-9b14-b937235f76a4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:56:59.973547 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-41491963-dee1-4229-9b14-b937235f76a4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:00.118238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-41491963-dee1-4229-9b14-b937235f76a4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:00.125951 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-41491963-dee1-4229-9b14-b937235f76a4 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1689 microversion: 2.1 time: 0.169074 Jul 12 03:57:00.126529 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 412/792] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:56:59 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:00.958374 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-4f36be2d-abfc-468a-ae91-e1cfbc5422e5 req-8e7d7d9e-2c6d-4f8a-afb6-bb148a05b390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e3bc04-35b0-412b-b8d6-65165bc79e60", "name": "network-vif-deleted", "tag": "a1b17494-72de-4c33-8c66-6af3d34f96b4"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:57:00.970846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-4f36be2d-abfc-468a-ae91-e1cfbc5422e5 req-8e7d7d9e-2c6d-4f8a-afb6-bb148a05b390 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:00.971384 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-4f36be2d-abfc-468a-ae91-e1cfbc5422e5 req-8e7d7d9e-2c6d-4f8a-afb6-bb148a05b390 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:00.988836 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-4f36be2d-abfc-468a-ae91-e1cfbc5422e5 req-8e7d7d9e-2c6d-4f8a-afb6-bb148a05b390 service nova] Creating event network-vif-deleted:a1b17494-72de-4c33-8c66-6af3d34f96b4 for instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 on hv-cinder-84773 Jul 12 03:57:00.995210 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-4f36be2d-abfc-468a-ae91-e1cfbc5422e5 req-8e7d7d9e-2c6d-4f8a-afb6-bb148a05b390 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040288 Jul 12 03:57:00.996752 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 381/793] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:01.144551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5c490f74-4a3a-41e1-82ba-4857e23245f5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:01.145916 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5c490f74-4a3a-41e1-82ba-4857e23245f5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:01.154117 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5c490f74-4a3a-41e1-82ba-4857e23245f5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:01.155119 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5c490f74-4a3a-41e1-82ba-4857e23245f5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:01.155904 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5c490f74-4a3a-41e1-82ba-4857e23245f5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:01.156388 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5c490f74-4a3a-41e1-82ba-4857e23245f5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:01.187756 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5c490f74-4a3a-41e1-82ba-4857e23245f5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:01.188252 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5c490f74-4a3a-41e1-82ba-4857e23245f5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:01.188702 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-5c490f74-4a3a-41e1-82ba-4857e23245f5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lazy-loading 'fault' on Instance uuid 82e3bc04-35b0-412b-b8d6-65165bc79e60 {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:57:01.229540 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5c490f74-4a3a-41e1-82ba-4857e23245f5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:01.237391 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5c490f74-4a3a-41e1-82ba-4857e23245f5 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 200 len: 1335 microversion: 2.1 time: 0.098213 Jul 12 03:57:01.238363 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 413/794] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:01 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:57:02.260623 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f869a444-10d2-4ace-b45c-3be8122afa8f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:02.261684 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f869a444-10d2-4ace-b45c-3be8122afa8f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 82e3bc04-35b0-412b-b8d6-65165bc79e60] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:02.269116 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f869a444-10d2-4ace-b45c-3be8122afa8f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:02.269615 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f869a444-10d2-4ace-b45c-3be8122afa8f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:02.270397 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f869a444-10d2-4ace-b45c-3be8122afa8f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:02.270858 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f869a444-10d2-4ace-b45c-3be8122afa8f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:02.285466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-f869a444-10d2-4ace-b45c-3be8122afa8f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] HTTP exception thrown: Instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 could not be found. Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f869a444-10d2-4ace-b45c-3be8122afa8f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Request method failure captured: Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 HTTP/1.1 Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO85KuFNBV6-7fhbKmf1HpN6NpFGL5F9bcT48Xy246CyrY1X-tZ6u1_GDiVEEcEOXK-36PJ2uqiZHJaN-K6sZMfqj7MllOAmWZRTHd3ToaqY0XJtpityteYLeRZ64xutpJXSWrWjQe5b6KmzxNtSsfX6_4rSQHrXOiL1YcZZVJ6djNA Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: fd03cff94a1842d8811deafa0dce10f9 Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:57:02.287193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:57:02.288916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd03cff94a1842d8811deafa0dce10f9"}]}] Jul 12 03:57:02.288916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:57:02.288916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: fd03cff94a1842d8811deafa0dce10f9 Jul 12 03:57:02.288916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:57:02.288916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-ServerRescueNegativeTestJSON-1509525019-project Jul 12 03:57:02.288916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:57:02.288916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:57:02.288916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 4ac2825db0c649cab6dcc2e27fbaf80d Jul 12 03:57:02.288916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1509525019-project Jul 12 03:57:02.288916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 03:57:02.288916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 could not be found. Jul 12 03:57:02.288916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': '82e3bc04-35b0-412b-b8d6-65165bc79e60'} Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 could not be found. Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:57:02.289862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 could not be found. Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 could not be found. Jul 12 03:57:02.291591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:02.293300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f869a444-10d2-4ace-b45c-3be8122afa8f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Returning 404 to user: Instance 82e3bc04-35b0-412b-b8d6-65165bc79e60 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:57:02.293300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f869a444-10d2-4ace-b45c-3be8122afa8f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60" status: 404 len: 111 microversion: 2.1 time: 0.036093 Jul 12 03:57:02.293300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 382/795] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:02 2022] GET /compute/v2.1/servers/82e3bc04-35b0-412b-b8d6-65165bc79e60 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:57:02.298011 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5e7a9447-eb5d-4a17-8281-568a7635ad1f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '.version_select at 0x7fd7fa648790>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:02.322864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5e7a9447-eb5d-4a17-8281-568a7635ad1f tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356440648" status: 202 len: 0 microversion: 2.1 time: 0.028544 Jul 12 03:57:02.323615 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 414/796] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jul 12 03:57:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356440648 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:57:05.241071 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-19a0b92e-b191-4c57-94bc-9bc9b5e1a2ba tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:05.241602 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-19a0b92e-b191-4c57-94bc-9bc9b5e1a2ba tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:05.248684 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-19a0b92e-b191-4c57-94bc-9bc9b5e1a2ba tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:05.249136 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-19a0b92e-b191-4c57-94bc-9bc9b5e1a2ba tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:05.249904 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-19a0b92e-b191-4c57-94bc-9bc9b5e1a2ba tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:05.250340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-19a0b92e-b191-4c57-94bc-9bc9b5e1a2ba tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:05.276041 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-19a0b92e-b191-4c57-94bc-9bc9b5e1a2ba tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:57:05.355028 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-19a0b92e-b191-4c57-94bc-9bc9b5e1a2ba tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "DELETE /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 204 len: 0 microversion: 2.1 time: 0.117500 Jul 12 03:57:05.355859 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 383/797] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:57:05 2022] DELETE /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:57:05.365435 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-10edcf92-c79e-4848-a847-b1dbccf7c039 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:05.366069 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-10edcf92-c79e-4848-a847-b1dbccf7c039 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:05.373145 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-10edcf92-c79e-4848-a847-b1dbccf7c039 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:05.373602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-10edcf92-c79e-4848-a847-b1dbccf7c039 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:05.374370 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-10edcf92-c79e-4848-a847-b1dbccf7c039 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:05.374848 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-10edcf92-c79e-4848-a847-b1dbccf7c039 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:05.512116 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-10edcf92-c79e-4848-a847-b1dbccf7c039 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:05.520255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-10edcf92-c79e-4848-a847-b1dbccf7c039 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1505 microversion: 2.1 time: 0.159593 Jul 12 03:57:05.520836 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 415/798] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:05 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:06.538594 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7d607b06-9925-4afd-9b9c-ea41794244db tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:06.539302 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7d607b06-9925-4afd-9b9c-ea41794244db tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:06.546080 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7d607b06-9925-4afd-9b9c-ea41794244db tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:06.546567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7d607b06-9925-4afd-9b9c-ea41794244db tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:06.547339 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7d607b06-9925-4afd-9b9c-ea41794244db tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:06.547778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7d607b06-9925-4afd-9b9c-ea41794244db tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:06.744996 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-7d607b06-9925-4afd-9b9c-ea41794244db tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:06.752947 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7d607b06-9925-4afd-9b9c-ea41794244db tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 200 len: 1505 microversion: 2.1 time: 0.218600 Jul 12 03:57:06.753533 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 384/799] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:06 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:06.893093 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-8a1bf971-2f42-41d0-ac03-c47af73d2f15 req-2abca3fa-427b-464d-a8e4-3d920b7ee9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150b0be7-7300-4733-a0bc-76a06ec8bf4e", "name": "network-vif-deleted", "tag": "d0f7e295-9d5e-45ea-b61d-7a13f716e4ae"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:57:06.902774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-8a1bf971-2f42-41d0-ac03-c47af73d2f15 req-2abca3fa-427b-464d-a8e4-3d920b7ee9f5 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:06.903214 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-8a1bf971-2f42-41d0-ac03-c47af73d2f15 req-2abca3fa-427b-464d-a8e4-3d920b7ee9f5 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:06.914557 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-8a1bf971-2f42-41d0-ac03-c47af73d2f15 req-2abca3fa-427b-464d-a8e4-3d920b7ee9f5 service nova] Creating event network-vif-deleted:d0f7e295-9d5e-45ea-b61d-7a13f716e4ae for instance 150b0be7-7300-4733-a0bc-76a06ec8bf4e on hv-cinder-84773 Jul 12 03:57:06.919500 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-8a1bf971-2f42-41d0-ac03-c47af73d2f15 req-2abca3fa-427b-464d-a8e4-3d920b7ee9f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030215 Jul 12 03:57:06.920301 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 416/800] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:07.774183 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f0cfcf13-4d7b-457c-9c58-9f9d16fdb61b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:07.775234 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f0cfcf13-4d7b-457c-9c58-9f9d16fdb61b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 150b0be7-7300-4733-a0bc-76a06ec8bf4e] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:07.785017 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f0cfcf13-4d7b-457c-9c58-9f9d16fdb61b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:07.785575 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f0cfcf13-4d7b-457c-9c58-9f9d16fdb61b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:07.786441 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f0cfcf13-4d7b-457c-9c58-9f9d16fdb61b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:07.786871 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f0cfcf13-4d7b-457c-9c58-9f9d16fdb61b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:07.800505 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-f0cfcf13-4d7b-457c-9c58-9f9d16fdb61b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] HTTP exception thrown: Instance 150b0be7-7300-4733-a0bc-76a06ec8bf4e could not be found. Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f0cfcf13-4d7b-457c-9c58-9f9d16fdb61b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Request method failure captured: Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e HTTP/1.1 Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO85KuFNBV6-7fhbKmf1HpN6NpFGL5F9bcT48Xy246CyrY1X-tZ6u1_GDiVEEcEOXK-36PJ2uqiZHJaN-K6sZMfqj7MllOAmWZRTHd3ToaqY0XJtpityteYLeRZ64xutpJXSWrWjQe5b6KmzxNtSsfX6_4rSQHrXOiL1YcZZVJ6djNA Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: fd03cff94a1842d8811deafa0dce10f9 Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:57:07.802197 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:57:07.803695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd03cff94a1842d8811deafa0dce10f9"}]}] Jul 12 03:57:07.803695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:57:07.803695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: fd03cff94a1842d8811deafa0dce10f9 Jul 12 03:57:07.803695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:57:07.803695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-ServerRescueNegativeTestJSON-1509525019-project Jul 12 03:57:07.803695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:57:07.803695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:57:07.803695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 4ac2825db0c649cab6dcc2e27fbaf80d Jul 12 03:57:07.803695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1509525019-project Jul 12 03:57:07.803695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 03:57:07.803695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance 150b0be7-7300-4733-a0bc-76a06ec8bf4e could not be found. Jul 12 03:57:07.803695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': '150b0be7-7300-4733-a0bc-76a06ec8bf4e'} Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150b0be7-7300-4733-a0bc-76a06ec8bf4e could not be found. Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:57:07.804670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150b0be7-7300-4733-a0bc-76a06ec8bf4e could not be found. Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150b0be7-7300-4733-a0bc-76a06ec8bf4e could not be found. Jul 12 03:57:07.806149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:07.807512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f0cfcf13-4d7b-457c-9c58-9f9d16fdb61b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Returning 404 to user: Instance 150b0be7-7300-4733-a0bc-76a06ec8bf4e could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:57:07.807512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f0cfcf13-4d7b-457c-9c58-9f9d16fdb61b tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e" status: 404 len: 111 microversion: 2.1 time: 0.036365 Jul 12 03:57:07.807512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 385/801] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:07 2022] GET /compute/v2.1/servers/150b0be7-7300-4733-a0bc-76a06ec8bf4e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:57:07.815101 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-135077a1-e40e-4b2d-9565-62716fca9e63 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:07.815695 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-135077a1-e40e-4b2d-9565-62716fca9e63 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:07.824697 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-135077a1-e40e-4b2d-9565-62716fca9e63 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:07.825147 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-135077a1-e40e-4b2d-9565-62716fca9e63 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:07.825946 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-135077a1-e40e-4b2d-9565-62716fca9e63 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:07.826385 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-135077a1-e40e-4b2d-9565-62716fca9e63 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:07.854409 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-135077a1-e40e-4b2d-9565-62716fca9e63 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Going to try to terminate instance {{(pid=124434) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:57:07.936988 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-135077a1-e40e-4b2d-9565-62716fca9e63 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 204 len: 0 microversion: 2.1 time: 0.126888 Jul 12 03:57:07.937780 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 417/802] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:57:07 2022] DELETE /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:57:07.946488 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bc14c9b4-821c-4264-84c9-fcd83bc74e44 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:07.947245 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-bc14c9b4-821c-4264-84c9-fcd83bc74e44 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:07.953542 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bc14c9b4-821c-4264-84c9-fcd83bc74e44 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:07.953989 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bc14c9b4-821c-4264-84c9-fcd83bc74e44 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:07.954787 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bc14c9b4-821c-4264-84c9-fcd83bc74e44 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:07.955218 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bc14c9b4-821c-4264-84c9-fcd83bc74e44 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:08.090774 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bc14c9b4-821c-4264-84c9-fcd83bc74e44 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:08.098638 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bc14c9b4-821c-4264-84c9-fcd83bc74e44 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1520 microversion: 2.1 time: 0.156594 Jul 12 03:57:08.099183 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 386/803] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:07 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:09.116774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f167a3e8-acfe-4295-b2d1-1f89ee352b58 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:09.117514 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f167a3e8-acfe-4295-b2d1-1f89ee352b58 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:09.124290 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f167a3e8-acfe-4295-b2d1-1f89ee352b58 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:09.124838 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f167a3e8-acfe-4295-b2d1-1f89ee352b58 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:09.125687 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f167a3e8-acfe-4295-b2d1-1f89ee352b58 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:09.126154 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f167a3e8-acfe-4295-b2d1-1f89ee352b58 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:09.192308 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f167a3e8-acfe-4295-b2d1-1f89ee352b58 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac2825db0c649cab6dcc2e27fbaf80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd03cff94a1842d8811deafa0dce10f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:09.201220 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f167a3e8-acfe-4295-b2d1-1f89ee352b58 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 200 len: 1478 microversion: 2.1 time: 0.088755 Jul 12 03:57:09.209976 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 418/804] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:09 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 1478 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:09.242767 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-157a0dbd-1757-465d-bdf2-b7e63fc9e51a req-3ae5aca6-c2dc-4abe-99f9-c5fe2ce091aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f1cbdb-c631-4f89-b3c5-8e74819e942d", "name": "network-vif-deleted", "tag": "9d25c1e9-86c8-4922-a334-9f6f33f80277"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:57:09.252182 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-157a0dbd-1757-465d-bdf2-b7e63fc9e51a req-3ae5aca6-c2dc-4abe-99f9-c5fe2ce091aa service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:09.252629 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-157a0dbd-1757-465d-bdf2-b7e63fc9e51a req-3ae5aca6-c2dc-4abe-99f9-c5fe2ce091aa service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:09.263384 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-157a0dbd-1757-465d-bdf2-b7e63fc9e51a req-3ae5aca6-c2dc-4abe-99f9-c5fe2ce091aa service nova] Creating event network-vif-deleted:9d25c1e9-86c8-4922-a334-9f6f33f80277 for instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d on hv-cinder-84773 Jul 12 03:57:09.268256 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-157a0dbd-1757-465d-bdf2-b7e63fc9e51a req-3ae5aca6-c2dc-4abe-99f9-c5fe2ce091aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029202 Jul 12 03:57:09.268851 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 387/805] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:10.227403 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f5944597-ef83-4deb-9efa-f405e46a1786 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:10.228195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f5944597-ef83-4deb-9efa-f405e46a1786 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] [instance: 48f1cbdb-c631-4f89-b3c5-8e74819e942d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:10.236306 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f5944597-ef83-4deb-9efa-f405e46a1786 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:10.236837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f5944597-ef83-4deb-9efa-f405e46a1786 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:10.237726 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f5944597-ef83-4deb-9efa-f405e46a1786 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:10.238266 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f5944597-ef83-4deb-9efa-f405e46a1786 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:10.255443 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-f5944597-ef83-4deb-9efa-f405e46a1786 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] HTTP exception thrown: Instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d could not be found. Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f5944597-ef83-4deb-9efa-f405e46a1786 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Request method failure captured: Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d HTTP/1.1 Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO85KuFNBV6-7fhbKmf1HpN6NpFGL5F9bcT48Xy246CyrY1X-tZ6u1_GDiVEEcEOXK-36PJ2uqiZHJaN-K6sZMfqj7MllOAmWZRTHd3ToaqY0XJtpityteYLeRZ64xutpJXSWrWjQe5b6KmzxNtSsfX6_4rSQHrXOiL1YcZZVJ6djNA Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: fd03cff94a1842d8811deafa0dce10f9 Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 03:57:10.257195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 03:57:10.258719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd03cff94a1842d8811deafa0dce10f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fd03cff94a1842d8811deafa0dce10f9"}]}] Jul 12 03:57:10.258719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:57:10.258719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: fd03cff94a1842d8811deafa0dce10f9 Jul 12 03:57:10.258719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1509525019 Jul 12 03:57:10.258719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-ServerRescueNegativeTestJSON-1509525019-project Jul 12 03:57:10.258719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 03:57:10.258719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 03:57:10.258719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 4ac2825db0c649cab6dcc2e27fbaf80d Jul 12 03:57:10.258719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1509525019-project Jul 12 03:57:10.258719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 03:57:10.258719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d could not be found. Jul 12 03:57:10.258719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': '48f1cbdb-c631-4f89-b3c5-8e74819e942d'} Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d could not be found. Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:57:10.259526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d could not be found. Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d could not be found. Jul 12 03:57:10.261055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:57:10.262360 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f5944597-ef83-4deb-9efa-f405e46a1786 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] Returning 404 to user: Instance 48f1cbdb-c631-4f89-b3c5-8e74819e942d could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:57:10.262360 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f5944597-ef83-4deb-9efa-f405e46a1786 tempest-ServerRescueNegativeTestJSON-1509525019 tempest-ServerRescueNegativeTestJSON-1509525019-project] 10.222.0.20 "GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d" status: 404 len: 111 microversion: 2.1 time: 0.036010 Jul 12 03:57:10.262360 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 419/806] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:10 2022] GET /compute/v2.1/servers/48f1cbdb-c631-4f89-b3c5-8e74819e942d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:57:16.204921 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-11687707-34e8-47b2-9db5-e8f63668bf51 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] Calling method '.version_select at 0x7fd7fa5a6280>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:16.252336 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-11687707-34e8-47b2-9db5-e8f63668bf51 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/265d46c1-436f-4094-9ccc-19c4d40631f3" status: 200 len: 351 microversion: 2.1 time: 0.052205 Jul 12 03:57:16.252909 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 388/807] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:57:16 2022] GET /compute/v2.1/os-volumes/265d46c1-436f-4094-9ccc-19c4d40631f3 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:17.595484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d687620c-37fa-460c-aeeb-5ed4bbfb825e tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] Calling method '.version_select at 0x7fd7fa4ff1f0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:17.647316 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d687620c-37fa-460c-aeeb-5ed4bbfb825e tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/80bb6bd6-bccf-4cdf-8328-993ae7047f73" status: 200 len: 350 microversion: 2.1 time: 0.055657 Jul 12 03:57:17.647880 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 420/808] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:57:17 2022] GET /compute/v2.1/os-volumes/80bb6bd6-bccf-4cdf-8328-993ae7047f73 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:18.997814 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a3e43b45-d00f-4732-93c3-57df2ab5c786 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] Calling method '.version_select at 0x7fd7fa448820>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:19.062044 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a3e43b45-d00f-4732-93c3-57df2ab5c786 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7a681bd9-e5e8-4845-9baa-14870a54e1dc" status: 200 len: 351 microversion: 2.1 time: 0.068333 Jul 12 03:57:19.062903 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 389/809] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 03:57:18 2022] GET /compute/v2.1/os-volumes/7a681bd9-e5e8-4845-9baa-14870a54e1dc => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:19.074860 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6627ec8b-7a1c-4ba6-b065-35821d1dce1c tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] Calling method '.version_select at 0x7fd7fa5b1f70>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:19.166879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-6627ec8b-7a1c-4ba6-b065-35821d1dce1c tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096327 Jul 12 03:57:19.167451 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 421/810] 10.222.0.20 () {58 vars in 1133 bytes} [Tue Jul 12 03:57:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:19.179950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a423d23c-368f-4cf5-ab02-24634ac5c1a7 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] Calling method '.version_select at 0x7fd7fa69caf0>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:19.249787 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:57:19.257708 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:57:19.261669 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a423d23c-368f-4cf5-ab02-24634ac5c1a7 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085798 Jul 12 03:57:19.262259 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 390/811] 10.222.0.20 () {58 vars in 1148 bytes} [Tue Jul 12 03:57:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:19.276732 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e22134a5-1d85-47b7-ad33-f2d97bad6a07 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] Calling method '.version_select at 0x7fd7fa55e160>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:19.357421 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e22134a5-1d85-47b7-ad33-f2d97bad6a07 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084872 Jul 12 03:57:19.357985 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 422/812] 10.222.0.20 () {58 vars in 1133 bytes} [Tue Jul 12 03:57:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:19.369350 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e41d1d0c-9acc-467d-bd6d-b5f83eb7b2f4 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] Calling method '.version_select at 0x7fd7fa4483a0>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:19.374150 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5f68d48b-3e5b-4d03-a7a7-b0a82e6f0cb4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:57:19.375076 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5f68d48b-3e5b-4d03-a7a7-b0a82e6f0cb4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:19.382145 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5f68d48b-3e5b-4d03-a7a7-b0a82e6f0cb4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:19.382582 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5f68d48b-3e5b-4d03-a7a7-b0a82e6f0cb4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:19.383338 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5f68d48b-3e5b-4d03-a7a7-b0a82e6f0cb4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:19.383728 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5f68d48b-3e5b-4d03-a7a7-b0a82e6f0cb4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:19.454816 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e41d1d0c-9acc-467d-bd6d-b5f83eb7b2f4 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089346 Jul 12 03:57:19.455392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 391/813] 10.222.0.20 () {58 vars in 1166 bytes} [Tue Jul 12 03:57:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:19.456330 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5f68d48b-3e5b-4d03-a7a7-b0a82e6f0cb4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "POST /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/action" status: 202 len: 0 microversion: 2.1 time: 0.085596 Jul 12 03:57:19.457023 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 423/814] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 03:57:19 2022] POST /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 03:57:19.465022 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-059642d6-0a11-4727-b839-13165ff652f4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:19.465823 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-059642d6-0a11-4727-b839-13165ff652f4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:19.469485 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9042eab2-e38d-4f46-863d-b6b83902642d tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] Calling method '.version_select at 0x7fd7fa94f670>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:19.472666 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-059642d6-0a11-4727-b839-13165ff652f4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:19.473109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-059642d6-0a11-4727-b839-13165ff652f4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:19.473864 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-059642d6-0a11-4727-b839-13165ff652f4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:19.474295 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-059642d6-0a11-4727-b839-13165ff652f4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:19.553521 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9042eab2-e38d-4f46-863d-b6b83902642d tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088173 Jul 12 03:57:19.554107 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 424/815] 10.222.0.20 () {58 vars in 1169 bytes} [Tue Jul 12 03:57:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:19.565847 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cdec26e9-edb5-415e-b8b1-9c4f0df1472c tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] Calling method '.version_select at 0x7fd7fa517430>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:19.646308 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cdec26e9-edb5-415e-b8b1-9c4f0df1472c tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084073 Jul 12 03:57:19.646889 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 425/816] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Jul 12 03:57:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:57:19.661047 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-54121969-a95a-4ad4-800d-62d338795610 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] Calling method '.version_select at 0x7fd7fa4ffe50>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:19.714986 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-059642d6-0a11-4727-b839-13165ff652f4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:19.723591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-059642d6-0a11-4727-b839-13165ff652f4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1752 microversion: 2.1 time: 0.262416 Jul 12 03:57:19.724308 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 392/817] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:19 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1752 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:19.745073 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-54121969-a95a-4ad4-800d-62d338795610 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087803 Jul 12 03:57:19.745685 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 426/818] 10.222.0.20 () {58 vars in 1187 bytes} [Tue Jul 12 03:57:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:19.757099 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-791d65ce-b07c-4314-9a40-94dc4d9950e7 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] Calling method '.version_select at 0x7fd7fa4b03a0>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:19.838473 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-791d65ce-b07c-4314-9a40-94dc4d9950e7 tempest-VolumesTestJSON-671232110 tempest-VolumesTestJSON-671232110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085147 Jul 12 03:57:19.839135 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 393/819] 10.222.0.20 () {58 vars in 1154 bytes} [Tue Jul 12 03:57:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:20.742424 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-396cdf45-d85f-4cdd-8e4a-8cdca064fdab tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:20.743193 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-396cdf45-d85f-4cdd-8e4a-8cdca064fdab tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:20.750454 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-396cdf45-d85f-4cdd-8e4a-8cdca064fdab tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:20.751039 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-396cdf45-d85f-4cdd-8e4a-8cdca064fdab tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:20.751827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-396cdf45-d85f-4cdd-8e4a-8cdca064fdab tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:20.752297 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-396cdf45-d85f-4cdd-8e4a-8cdca064fdab tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:20.906828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-396cdf45-d85f-4cdd-8e4a-8cdca064fdab tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:20.915153 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-396cdf45-d85f-4cdd-8e4a-8cdca064fdab tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.177213 Jul 12 03:57:20.915699 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 427/820] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:20 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:21.935081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2f2b6c6a-dffd-43d9-9942-6478ac07fa7d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:21.935621 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-2f2b6c6a-dffd-43d9-9942-6478ac07fa7d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:21.948024 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2f2b6c6a-dffd-43d9-9942-6478ac07fa7d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:21.948511 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2f2b6c6a-dffd-43d9-9942-6478ac07fa7d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:21.949286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2f2b6c6a-dffd-43d9-9942-6478ac07fa7d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:21.949706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2f2b6c6a-dffd-43d9-9942-6478ac07fa7d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:22.097357 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-2f2b6c6a-dffd-43d9-9942-6478ac07fa7d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:22.106254 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-2f2b6c6a-dffd-43d9-9942-6478ac07fa7d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.175674 Jul 12 03:57:22.106838 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 394/821] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:21 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:23.127408 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b49a0456-44a7-4957-9c05-70e01e3e58ac tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:23.128180 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b49a0456-44a7-4957-9c05-70e01e3e58ac tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:23.136408 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b49a0456-44a7-4957-9c05-70e01e3e58ac tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:23.136958 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b49a0456-44a7-4957-9c05-70e01e3e58ac tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:23.137843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b49a0456-44a7-4957-9c05-70e01e3e58ac tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:23.138361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b49a0456-44a7-4957-9c05-70e01e3e58ac tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:23.290420 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b49a0456-44a7-4957-9c05-70e01e3e58ac tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:23.298898 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b49a0456-44a7-4957-9c05-70e01e3e58ac tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.177722 Jul 12 03:57:23.299483 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 428/822] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:23 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:24.316495 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3f905144-62ca-4ec1-a1ae-83430c2801ef tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:24.317213 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3f905144-62ca-4ec1-a1ae-83430c2801ef tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:24.323890 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3f905144-62ca-4ec1-a1ae-83430c2801ef tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:24.324401 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3f905144-62ca-4ec1-a1ae-83430c2801ef tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:24.325154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3f905144-62ca-4ec1-a1ae-83430c2801ef tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:24.325590 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3f905144-62ca-4ec1-a1ae-83430c2801ef tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:24.473757 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3f905144-62ca-4ec1-a1ae-83430c2801ef tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:24.481906 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3f905144-62ca-4ec1-a1ae-83430c2801ef tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.169450 Jul 12 03:57:24.482465 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 395/823] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:24 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:25.499685 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a703d0b0-34af-4265-bf93-a15d6d04e026 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:25.500331 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a703d0b0-34af-4265-bf93-a15d6d04e026 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:25.502949 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:57:25.509654 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a703d0b0-34af-4265-bf93-a15d6d04e026 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:25.510387 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a703d0b0-34af-4265-bf93-a15d6d04e026 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:25.511164 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a703d0b0-34af-4265-bf93-a15d6d04e026 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:25.511600 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a703d0b0-34af-4265-bf93-a15d6d04e026 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:25.514787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:57:25.672987 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a703d0b0-34af-4265-bf93-a15d6d04e026 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:25.681570 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a703d0b0-34af-4265-bf93-a15d6d04e026 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.186010 Jul 12 03:57:25.682144 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 429/824] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:25 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:26.699178 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5f064d1f-04a2-4c7e-ac8d-b8cac552a29d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:26.699804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5f064d1f-04a2-4c7e-ac8d-b8cac552a29d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:26.706836 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f064d1f-04a2-4c7e-ac8d-b8cac552a29d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:26.707276 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f064d1f-04a2-4c7e-ac8d-b8cac552a29d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:26.708146 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f064d1f-04a2-4c7e-ac8d-b8cac552a29d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:26.708626 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5f064d1f-04a2-4c7e-ac8d-b8cac552a29d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:26.857338 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5f064d1f-04a2-4c7e-ac8d-b8cac552a29d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:26.866006 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5f064d1f-04a2-4c7e-ac8d-b8cac552a29d tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.171078 Jul 12 03:57:26.866587 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 396/825] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:26 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:27.887132 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4a016747-7812-40cb-b066-9c184ae0c0fc tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:27.888177 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4a016747-7812-40cb-b066-9c184ae0c0fc tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:27.896652 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4a016747-7812-40cb-b066-9c184ae0c0fc tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:27.897105 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4a016747-7812-40cb-b066-9c184ae0c0fc tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:27.897852 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4a016747-7812-40cb-b066-9c184ae0c0fc tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:27.898316 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4a016747-7812-40cb-b066-9c184ae0c0fc tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:28.055957 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4a016747-7812-40cb-b066-9c184ae0c0fc tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:28.064259 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4a016747-7812-40cb-b066-9c184ae0c0fc tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.183748 Jul 12 03:57:28.064795 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 430/826] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:27 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:29.085752 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-cf737636-0894-4fdd-b0db-74e4c3a00264 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:29.086789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-cf737636-0894-4fdd-b0db-74e4c3a00264 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:29.096802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cf737636-0894-4fdd-b0db-74e4c3a00264 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:29.097248 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cf737636-0894-4fdd-b0db-74e4c3a00264 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:29.098003 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cf737636-0894-4fdd-b0db-74e4c3a00264 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:29.098442 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cf737636-0894-4fdd-b0db-74e4c3a00264 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:29.247080 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-cf737636-0894-4fdd-b0db-74e4c3a00264 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:29.255213 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-cf737636-0894-4fdd-b0db-74e4c3a00264 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.176056 Jul 12 03:57:29.255767 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 397/827] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:29 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:30.277992 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9fcec968-0590-49fa-b238-0d3ba3d2b08b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:30.278897 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-9fcec968-0590-49fa-b238-0d3ba3d2b08b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:30.287590 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9fcec968-0590-49fa-b238-0d3ba3d2b08b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:30.288038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9fcec968-0590-49fa-b238-0d3ba3d2b08b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:30.288850 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9fcec968-0590-49fa-b238-0d3ba3d2b08b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:30.289310 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9fcec968-0590-49fa-b238-0d3ba3d2b08b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:30.440284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9fcec968-0590-49fa-b238-0d3ba3d2b08b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:30.448814 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9fcec968-0590-49fa-b238-0d3ba3d2b08b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.177848 Jul 12 03:57:30.449361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 431/828] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:30 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:31.470232 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a48e358c-5598-4341-8871-a1360bc2ce8c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:31.471293 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a48e358c-5598-4341-8871-a1360bc2ce8c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:31.481940 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a48e358c-5598-4341-8871-a1360bc2ce8c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:31.482680 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a48e358c-5598-4341-8871-a1360bc2ce8c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:31.483949 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a48e358c-5598-4341-8871-a1360bc2ce8c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:31.484721 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a48e358c-5598-4341-8871-a1360bc2ce8c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:31.632743 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a48e358c-5598-4341-8871-a1360bc2ce8c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:31.644042 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a48e358c-5598-4341-8871-a1360bc2ce8c tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.180452 Jul 12 03:57:31.644607 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 398/829] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:31 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:32.560430 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2aeda6ea-0b7f-480d-86e3-fd64de57f9ec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:32.561368 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2aeda6ea-0b7f-480d-86e3-fd64de57f9ec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:32.568396 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2aeda6ea-0b7f-480d-86e3-fd64de57f9ec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:32.568854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2aeda6ea-0b7f-480d-86e3-fd64de57f9ec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:32.569633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2aeda6ea-0b7f-480d-86e3-fd64de57f9ec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:32.570075 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2aeda6ea-0b7f-480d-86e3-fd64de57f9ec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:32.598854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2aeda6ea-0b7f-480d-86e3-fd64de57f9ec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042515 Jul 12 03:57:32.599706 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 432/830] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 03:57:32 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 03:57:32.662045 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-24920964-39eb-4f3c-a4ce-cb1ec96b8080 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:32.662746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-24920964-39eb-4f3c-a4ce-cb1ec96b8080 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:32.663057 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a99cfb0a-cfc4-4074-9b2e-8ca944d691f3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:32.663563 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a99cfb0a-cfc4-4074-9b2e-8ca944d691f3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:32.669460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-24920964-39eb-4f3c-a4ce-cb1ec96b8080 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:32.669747 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a99cfb0a-cfc4-4074-9b2e-8ca944d691f3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:32.669882 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-24920964-39eb-4f3c-a4ce-cb1ec96b8080 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:32.670197 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a99cfb0a-cfc4-4074-9b2e-8ca944d691f3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:32.670690 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-24920964-39eb-4f3c-a4ce-cb1ec96b8080 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:32.670965 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a99cfb0a-cfc4-4074-9b2e-8ca944d691f3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:32.671122 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-24920964-39eb-4f3c-a4ce-cb1ec96b8080 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:32.671437 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a99cfb0a-cfc4-4074-9b2e-8ca944d691f3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:32.697326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a99cfb0a-cfc4-4074-9b2e-8ca944d691f3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Going to try to terminate instance {{(pid=124434) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:57:32.779824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a99cfb0a-cfc4-4074-9b2e-8ca944d691f3 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 204 len: 0 microversion: 2.1 time: 0.120499 Jul 12 03:57:32.780842 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 433/831] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:57:32 2022] DELETE /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 03:57:32.791338 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c8ee5325-56e0-453b-903c-6163a6015348 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:32.792168 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c8ee5325-56e0-453b-903c-6163a6015348 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:32.799477 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c8ee5325-56e0-453b-903c-6163a6015348 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:32.799927 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c8ee5325-56e0-453b-903c-6163a6015348 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:32.800730 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c8ee5325-56e0-453b-903c-6163a6015348 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:32.801167 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c8ee5325-56e0-453b-903c-6163a6015348 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:32.822705 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-24920964-39eb-4f3c-a4ce-cb1ec96b8080 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:32.830936 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-24920964-39eb-4f3c-a4ce-cb1ec96b8080 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.172839 Jul 12 03:57:32.831540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 399/832] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:32 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:32.939560 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c8ee5325-56e0-453b-903c-6163a6015348 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:32.947361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c8ee5325-56e0-453b-903c-6163a6015348 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1674 microversion: 2.1 time: 0.162006 Jul 12 03:57:32.948158 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 434/833] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:32 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:33.847993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-85fb6e44-d977-4c8f-b139-d51621e61d39 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:33.848590 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-85fb6e44-d977-4c8f-b139-d51621e61d39 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:33.855181 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-85fb6e44-d977-4c8f-b139-d51621e61d39 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:33.855610 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-85fb6e44-d977-4c8f-b139-d51621e61d39 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:33.856408 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-85fb6e44-d977-4c8f-b139-d51621e61d39 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:33.856821 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-85fb6e44-d977-4c8f-b139-d51621e61d39 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:33.965904 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-665a75dc-75d4-4ecf-b98f-70d954ed8960 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:33.966607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-665a75dc-75d4-4ecf-b98f-70d954ed8960 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:33.973320 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-665a75dc-75d4-4ecf-b98f-70d954ed8960 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:33.973768 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-665a75dc-75d4-4ecf-b98f-70d954ed8960 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:33.974550 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-665a75dc-75d4-4ecf-b98f-70d954ed8960 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:33.974982 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-665a75dc-75d4-4ecf-b98f-70d954ed8960 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:34.035057 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-85fb6e44-d977-4c8f-b139-d51621e61d39 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:34.042130 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-85fb6e44-d977-4c8f-b139-d51621e61d39 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.198006 Jul 12 03:57:34.053783 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 400/834] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:33 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:57:34.120627 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-665a75dc-75d4-4ecf-b98f-70d954ed8960 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:34.128422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-665a75dc-75d4-4ecf-b98f-70d954ed8960 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1674 microversion: 2.1 time: 0.167519 Jul 12 03:57:34.129023 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 435/835] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:33 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:57:35.062068 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-89b497f6-358a-4268-880a-5baa2c211863 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:35.062850 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-89b497f6-358a-4268-880a-5baa2c211863 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:35.070315 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-89b497f6-358a-4268-880a-5baa2c211863 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:35.071310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-89b497f6-358a-4268-880a-5baa2c211863 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:35.071529 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-89b497f6-358a-4268-880a-5baa2c211863 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:35.071955 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-89b497f6-358a-4268-880a-5baa2c211863 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:35.145791 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c6ef5a5f-937e-4a1e-a392-17d18c518d58 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:35.146441 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c6ef5a5f-937e-4a1e-a392-17d18c518d58 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:35.154432 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6ef5a5f-937e-4a1e-a392-17d18c518d58 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:35.155213 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6ef5a5f-937e-4a1e-a392-17d18c518d58 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:35.156263 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6ef5a5f-937e-4a1e-a392-17d18c518d58 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:35.156696 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6ef5a5f-937e-4a1e-a392-17d18c518d58 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:35.235074 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c6ef5a5f-937e-4a1e-a392-17d18c518d58 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:35.242955 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c6ef5a5f-937e-4a1e-a392-17d18c518d58 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1607 microversion: 2.1 time: 0.101075 Jul 12 03:57:35.243521 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 436/836] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:35 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1607 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:35.306807 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-89b497f6-358a-4268-880a-5baa2c211863 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:35.317003 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-89b497f6-358a-4268-880a-5baa2c211863 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.259340 Jul 12 03:57:35.317746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 401/837] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:35 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:35.487251 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-9df1fda8-ae2b-4b99-9f74-320ba4060fc5 req-29e82a29-a07d-4319-9efd-1c2d71527fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83ba0f3-55f9-4a38-9794-46bb9876f0d7", "name": "network-vif-deleted", "tag": "8a62f409-2f00-4669-85c4-d882010074e6"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:57:35.499937 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-9df1fda8-ae2b-4b99-9f74-320ba4060fc5 req-29e82a29-a07d-4319-9efd-1c2d71527fd4 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:35.500750 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-9df1fda8-ae2b-4b99-9f74-320ba4060fc5 req-29e82a29-a07d-4319-9efd-1c2d71527fd4 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:35.515841 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-9df1fda8-ae2b-4b99-9f74-320ba4060fc5 req-29e82a29-a07d-4319-9efd-1c2d71527fd4 service nova] Creating event network-vif-deleted:8a62f409-2f00-4669-85c4-d882010074e6 for instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 on hv-cinder-84773 Jul 12 03:57:35.528913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-9df1fda8-ae2b-4b99-9f74-320ba4060fc5 req-29e82a29-a07d-4319-9efd-1c2d71527fd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045365 Jul 12 03:57:35.530100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 437/838] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:36.261966 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bb4e0a7d-87e4-4d15-9007-e909bf94c649 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:36.262670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-bb4e0a7d-87e4-4d15-9007-e909bf94c649 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:36.269504 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bb4e0a7d-87e4-4d15-9007-e909bf94c649 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:36.269930 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bb4e0a7d-87e4-4d15-9007-e909bf94c649 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:36.270826 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bb4e0a7d-87e4-4d15-9007-e909bf94c649 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:36.271094 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bb4e0a7d-87e4-4d15-9007-e909bf94c649 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:36.306962 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bb4e0a7d-87e4-4d15-9007-e909bf94c649 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:36.307403 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bb4e0a7d-87e4-4d15-9007-e909bf94c649 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:36.307847 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.objects.instance [None req-bb4e0a7d-87e4-4d15-9007-e909bf94c649 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lazy-loading 'fault' on Instance uuid e83ba0f3-55f9-4a38-9794-46bb9876f0d7 {{(pid=124435) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:57:36.335551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d5026330-cca2-4931-a3ae-54acdf178a37 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:36.336295 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d5026330-cca2-4931-a3ae-54acdf178a37 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:36.344989 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d5026330-cca2-4931-a3ae-54acdf178a37 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:36.346031 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d5026330-cca2-4931-a3ae-54acdf178a37 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:36.347186 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d5026330-cca2-4931-a3ae-54acdf178a37 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:36.347962 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d5026330-cca2-4931-a3ae-54acdf178a37 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:36.361693 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-bb4e0a7d-87e4-4d15-9007-e909bf94c649 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:36.372954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bb4e0a7d-87e4-4d15-9007-e909bf94c649 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 200 len: 1328 microversion: 2.1 time: 0.114810 Jul 12 03:57:36.373852 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 402/839] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:36 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 1328 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:36.768891 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d5026330-cca2-4931-a3ae-54acdf178a37 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:36.777271 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d5026330-cca2-4931-a3ae-54acdf178a37 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.446491 Jul 12 03:57:36.777820 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 438/840] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:36 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:57:37.393942 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-93f0915c-13b8-43c4-af52-e10ca80d0312 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:37.394571 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-93f0915c-13b8-43c4-af52-e10ca80d0312 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:37.401980 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-93f0915c-13b8-43c4-af52-e10ca80d0312 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:37.402429 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-93f0915c-13b8-43c4-af52-e10ca80d0312 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:37.403193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-93f0915c-13b8-43c4-af52-e10ca80d0312 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:37.403633 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-93f0915c-13b8-43c4-af52-e10ca80d0312 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:37.417110 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-93f0915c-13b8-43c4-af52-e10ca80d0312 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] HTTP exception thrown: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-93f0915c-13b8-43c4-af52-e10ca80d0312 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Request method failure captured: Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 HTTP/1.1 Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO-gJ7kDGy6dVaiKGKo8CX9Ky2cDF0Skq1U_TQB9CcUv8z7tzu1s0RTqU-uMNuF4XsBgVq3WyidHTf0iVrtVovi2yQUdZtSdhk-dNXYfiWX2z8gsRZ33xIMHvNT-8h92q_7OKsQuLKDgiAX9DVoVGuBKSbowlvoAv8Nlqo_L61yCpsg Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 2ceaecc3b7fc4fed9dce1e3ab1014ed2 Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeTestJSON-21093929 Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 03:57:37.418741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 03:57:37.420246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}] Jul 12 03:57:37.420246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeTestJSON-21093929 Jul 12 03:57:37.420246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 2ceaecc3b7fc4fed9dce1e3ab1014ed2 Jul 12 03:57:37.420246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeTestJSON-21093929 Jul 12 03:57:37.420246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeTestJSON-21093929-project Jul 12 03:57:37.420246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 03:57:37.420246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 03:57:37.420246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: b10d2c10313c4be2a8c11cff1eed8852 Jul 12 03:57:37.420246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeTestJSON-21093929-project Jul 12 03:57:37.420246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 03:57:37.420246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 03:57:37.420246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'e83ba0f3-55f9-4a38-9794-46bb9876f0d7'} Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:57:37.421040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 03:57:37.422523 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 03:57:37.424269 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-93f0915c-13b8-43c4-af52-e10ca80d0312 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Returning 404 to user: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:57:37.424269 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-93f0915c-13b8-43c4-af52-e10ca80d0312 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 404 len: 111 microversion: 2.1 time: 0.031567 Jul 12 03:57:37.424269 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 403/841] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:37 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:57:37.429429 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8784661e-fbf1-4918-a698-e09bbdc4c842 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '.version_select at 0x7fd7fa4cbca0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:37.448346 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8784661e-fbf1-4918-a698-e09bbdc4c842 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433189775" status: 202 len: 0 microversion: 2.1 time: 0.022869 Jul 12 03:57:37.448896 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 439/842] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jul 12 03:57:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433189775 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:57:37.794890 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6a7e5f5e-bdfd-495a-98c5-89a34069458e tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:37.795625 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6a7e5f5e-bdfd-495a-98c5-89a34069458e tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:37.803808 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a7e5f5e-bdfd-495a-98c5-89a34069458e tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:37.804566 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a7e5f5e-bdfd-495a-98c5-89a34069458e tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:37.805351 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a7e5f5e-bdfd-495a-98c5-89a34069458e tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:37.805970 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6a7e5f5e-bdfd-495a-98c5-89a34069458e tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:37.964507 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6a7e5f5e-bdfd-495a-98c5-89a34069458e tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:37.973153 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6a7e5f5e-bdfd-495a-98c5-89a34069458e tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1757 microversion: 2.1 time: 0.182135 Jul 12 03:57:37.974080 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 404/843] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:37 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:38.103808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-df1b3f7d-157e-4682-9004-fd686ef30883 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Action: 'create', calling method: .version_select at 0x7fd7fa60a280>, body: {"keypair": {"name": "tempest-keypair-659661136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj5/lNdZ9tRgjYpjV0REeJ4gbP4825eMtH9dw62p4amBPE7Z/vH3ZYAkjUrSWfmTndFWbRr/xUqNB4kI+AY+Z32IL3Vf9RwUa27UIzno5RB/KuyOxktUFA4hoNssQhFIw=="}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:57:38.118946 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-df1b3f7d-157e-4682-9004-fd686ef30883 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Getting quotas for project 2ceaecc3b7fc4fed9dce1e3ab1014ed2. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:57:38.122790 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-df1b3f7d-157e-4682-9004-fd686ef30883 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Getting quotas for user b10d2c10313c4be2a8c11cff1eed8852 and project 2ceaecc3b7fc4fed9dce1e3ab1014ed2. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:57:38.147990 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-df1b3f7d-157e-4682-9004-fd686ef30883 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048367 Jul 12 03:57:38.148759 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 440/844] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 03:57:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:38.990802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-28177557-b611-4189-b19d-8ce2df959f27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:38.991414 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-28177557-b611-4189-b19d-8ce2df959f27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:38.998017 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28177557-b611-4189-b19d-8ce2df959f27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:38.998466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28177557-b611-4189-b19d-8ce2df959f27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:38.999236 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28177557-b611-4189-b19d-8ce2df959f27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:38.999854 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28177557-b611-4189-b19d-8ce2df959f27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:39.150617 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-28177557-b611-4189-b19d-8ce2df959f27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:39.159254 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-28177557-b611-4189-b19d-8ce2df959f27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1760 microversion: 2.1 time: 0.172379 Jul 12 03:57:39.159830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 405/845] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:38 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1760 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:39.485945 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1364057096", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80ccb6a1-8d31-4e74-9f2c-15bfc89127e9"}], "security_groups": [{"name": "tempest-securitygroup--1726597467"}], "key_name": "tempest-keypair-659661136", "user_data": "}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:57:39.590760 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.network.neutron [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] validate_networks() for [('80ccb6a1-8d31-4e74-9f2c-15bfc89127e9', None, None, None, None, None)] {{(pid=124434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:57:39.976255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Flavor limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:57:39.976681 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Image limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:57:39.977165 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Flavor pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:57:39.977570 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Image pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:57:39.977980 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:57:39.988025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:39.988480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:39.989314 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:39.989717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:40.006691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Getting quotas for project 2ceaecc3b7fc4fed9dce1e3ab1014ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:57:40.010621 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Getting quotas for user b10d2c10313c4be2a8c11cff1eed8852 and project 2ceaecc3b7fc4fed9dce1e3ab1014ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:57:40.021643 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Going to run 1 instances... {{(pid=124434) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:57:40.023887 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:57:40.081719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-114a66fa-3095-4d38-b406-051cd61f87b4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.603648 Jul 12 03:57:40.082383 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 441/846] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:57:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 03:57:40.093343 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2b138a5b-bd25-4172-a97d-a996b5811547 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:40.093950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-2b138a5b-bd25-4172-a97d-a996b5811547 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:40.150332 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-2b138a5b-bd25-4172-a97d-a996b5811547 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:40.157808 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-2b138a5b-bd25-4172-a97d-a996b5811547 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1237 microversion: 2.1 time: 0.068287 Jul 12 03:57:40.158387 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 406/847] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:40 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:40.215666 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0c6f68e6-5407-4be9-a091-c878a8bc5536 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:40.216279 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0c6f68e6-5407-4be9-a091-c878a8bc5536 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:40.223054 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0c6f68e6-5407-4be9-a091-c878a8bc5536 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:40.223497 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0c6f68e6-5407-4be9-a091-c878a8bc5536 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:40.224281 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0c6f68e6-5407-4be9-a091-c878a8bc5536 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:40.224711 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0c6f68e6-5407-4be9-a091-c878a8bc5536 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:40.248039 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0c6f68e6-5407-4be9-a091-c878a8bc5536 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/ips" status: 200 len: 152 microversion: 2.20 time: 0.036499 Jul 12 03:57:40.248598 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 442/848] 10.222.0.20 () {60 vars in 1288 bytes} [Tue Jul 12 03:57:40 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:57:41.174927 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5c1d08cb-3cbd-47ca-b36a-3d2d765412fb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:41.176276 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5c1d08cb-3cbd-47ca-b36a-3d2d765412fb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:41.183703 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5c1d08cb-3cbd-47ca-b36a-3d2d765412fb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:41.184461 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5c1d08cb-3cbd-47ca-b36a-3d2d765412fb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:41.185232 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5c1d08cb-3cbd-47ca-b36a-3d2d765412fb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:41.185692 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5c1d08cb-3cbd-47ca-b36a-3d2d765412fb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:41.270244 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5c1d08cb-3cbd-47ca-b36a-3d2d765412fb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:41.279038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5c1d08cb-3cbd-47ca-b36a-3d2d765412fb tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1307 microversion: 2.1 time: 0.107658 Jul 12 03:57:41.279972 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 407/849] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:41 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:42.040335 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1dc57d82-a945-4146-8cc6-d88fc7935df5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:57:42.040878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1dc57d82-a945-4146-8cc6-d88fc7935df5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:42.047789 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1dc57d82-a945-4146-8cc6-d88fc7935df5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:42.048410 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1dc57d82-a945-4146-8cc6-d88fc7935df5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:42.049196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1dc57d82-a945-4146-8cc6-d88fc7935df5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:42.049641 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1dc57d82-a945-4146-8cc6-d88fc7935df5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:42.073787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-1dc57d82-a945-4146-8cc6-d88fc7935df5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lazy-loading 'flavor' on Instance uuid bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:57:42.296789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f877614c-f3b7-430c-a291-a22d19f5fbd2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:42.298299 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f877614c-f3b7-430c-a291-a22d19f5fbd2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:42.305532 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f877614c-f3b7-430c-a291-a22d19f5fbd2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:42.305945 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f877614c-f3b7-430c-a291-a22d19f5fbd2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:42.306936 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f877614c-f3b7-430c-a291-a22d19f5fbd2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:42.307305 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f877614c-f3b7-430c-a291-a22d19f5fbd2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:42.346284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1dc57d82-a945-4146-8cc6-d88fc7935df5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "POST /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/action" status: 202 len: 0 microversion: 2.20 time: 0.309755 Jul 12 03:57:42.347140 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 443/850] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jul 12 03:57:42 2022] POST /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:57:42.355456 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6e8e9678-f686-423f-b25f-d6aa587b1218 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:42.356409 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-6e8e9678-f686-423f-b25f-d6aa587b1218 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:42.363181 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6e8e9678-f686-423f-b25f-d6aa587b1218 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:42.363908 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6e8e9678-f686-423f-b25f-d6aa587b1218 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:42.364697 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6e8e9678-f686-423f-b25f-d6aa587b1218 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:42.365123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6e8e9678-f686-423f-b25f-d6aa587b1218 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:42.501609 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-6e8e9678-f686-423f-b25f-d6aa587b1218 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:42.509102 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f877614c-f3b7-430c-a291-a22d19f5fbd2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:42.509937 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-6e8e9678-f686-423f-b25f-d6aa587b1218 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:42.511614 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-6e8e9678-f686-423f-b25f-d6aa587b1218 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:42.513206 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-6e8e9678-f686-423f-b25f-d6aa587b1218 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.162045 Jul 12 03:57:42.514291 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 444/851] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:42 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:57:42.529900 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f877614c-f3b7-430c-a291-a22d19f5fbd2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.236857 Jul 12 03:57:42.530482 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 408/852] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:42 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:57:42.786639 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-fa9b29bc-a2da-4400-b4da-d7b4e11efb92 req-ecd06976-dcf2-4b4e-b337-d2cd6391928a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0", "tag": "b4d13628-bffc-4297-8cf1-0d24b7c4bea0"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:57:42.799385 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-fa9b29bc-a2da-4400-b4da-d7b4e11efb92 req-ecd06976-dcf2-4b4e-b337-d2cd6391928a service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:42.799936 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-fa9b29bc-a2da-4400-b4da-d7b4e11efb92 req-ecd06976-dcf2-4b4e-b337-d2cd6391928a service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:42.813006 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-fa9b29bc-a2da-4400-b4da-d7b4e11efb92 req-ecd06976-dcf2-4b4e-b337-d2cd6391928a service nova] Creating event network-changed:b4d13628-bffc-4297-8cf1-0d24b7c4bea0 for instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 on hv-cinder-84773 Jul 12 03:57:42.817791 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-fa9b29bc-a2da-4400-b4da-d7b4e11efb92 req-ecd06976-dcf2-4b4e-b337-d2cd6391928a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034940 Jul 12 03:57:42.818638 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 445/853] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:43.537845 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ba0342d0-5fa6-41fd-88d1-674227bde1fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:43.538679 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ba0342d0-5fa6-41fd-88d1-674227bde1fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:43.549448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ba0342d0-5fa6-41fd-88d1-674227bde1fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:43.549905 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ba0342d0-5fa6-41fd-88d1-674227bde1fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:43.550675 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ba0342d0-5fa6-41fd-88d1-674227bde1fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:43.551045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1022920c-10c7-4b27-8f5d-e801cc78fc53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:43.551525 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ba0342d0-5fa6-41fd-88d1-674227bde1fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:43.551748 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1022920c-10c7-4b27-8f5d-e801cc78fc53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:43.558347 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1022920c-10c7-4b27-8f5d-e801cc78fc53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:43.558796 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1022920c-10c7-4b27-8f5d-e801cc78fc53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:43.559561 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1022920c-10c7-4b27-8f5d-e801cc78fc53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:43.560018 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1022920c-10c7-4b27-8f5d-e801cc78fc53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:43.574940 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:57:43.681983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ba0342d0-5fa6-41fd-88d1-674227bde1fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:43.693069 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1022920c-10c7-4b27-8f5d-e801cc78fc53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:43.696770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ba0342d0-5fa6-41fd-88d1-674227bde1fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:43.698552 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ba0342d0-5fa6-41fd-88d1-674227bde1fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:43.700173 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ba0342d0-5fa6-41fd-88d1-674227bde1fb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.169039 Jul 12 03:57:43.700736 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 409/854] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:43 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:43.701087 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1022920c-10c7-4b27-8f5d-e801cc78fc53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.156308 Jul 12 03:57:43.701630 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 446/855] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:43 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:44.718344 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1dffc390-3ebb-45f2-bcdd-0dedca4369c6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:44.718893 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f52d9a10-eea4-40a4-9f09-b8fff848cb58 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:44.719271 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1dffc390-3ebb-45f2-bcdd-0dedca4369c6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:44.719362 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f52d9a10-eea4-40a4-9f09-b8fff848cb58 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:44.725788 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1dffc390-3ebb-45f2-bcdd-0dedca4369c6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:44.725956 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f52d9a10-eea4-40a4-9f09-b8fff848cb58 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:44.726241 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1dffc390-3ebb-45f2-bcdd-0dedca4369c6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:44.726410 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f52d9a10-eea4-40a4-9f09-b8fff848cb58 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:44.727003 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1dffc390-3ebb-45f2-bcdd-0dedca4369c6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:44.727148 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f52d9a10-eea4-40a4-9f09-b8fff848cb58 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:44.727438 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1dffc390-3ebb-45f2-bcdd-0dedca4369c6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:44.727582 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f52d9a10-eea4-40a4-9f09-b8fff848cb58 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:44.858232 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f52d9a10-eea4-40a4-9f09-b8fff848cb58 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:44.862101 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1dffc390-3ebb-45f2-bcdd-0dedca4369c6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:44.865628 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=100 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:57:44.866438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f52d9a10-eea4-40a4-9f09-b8fff848cb58 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:44.867990 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f52d9a10-eea4-40a4-9f09-b8fff848cb58 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:44.869432 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f52d9a10-eea4-40a4-9f09-b8fff848cb58 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.154991 Jul 12 03:57:44.869997 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 447/856] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:44 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:44.870421 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1dffc390-3ebb-45f2-bcdd-0dedca4369c6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.156120 Jul 12 03:57:44.870983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 410/857] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:44 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:45.887158 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-087926c2-75e1-48f8-b69c-a882f7fa8e7d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:45.887831 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-892a20ad-9df1-4ba0-a64e-aed3f6cc4ed8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:45.888324 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-087926c2-75e1-48f8-b69c-a882f7fa8e7d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:45.888468 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-892a20ad-9df1-4ba0-a64e-aed3f6cc4ed8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:45.894995 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-087926c2-75e1-48f8-b69c-a882f7fa8e7d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:45.895742 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-087926c2-75e1-48f8-b69c-a882f7fa8e7d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:45.896457 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-892a20ad-9df1-4ba0-a64e-aed3f6cc4ed8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:45.896576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-087926c2-75e1-48f8-b69c-a882f7fa8e7d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:45.896901 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-892a20ad-9df1-4ba0-a64e-aed3f6cc4ed8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:45.897044 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-087926c2-75e1-48f8-b69c-a882f7fa8e7d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:45.897675 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-892a20ad-9df1-4ba0-a64e-aed3f6cc4ed8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:45.898215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-892a20ad-9df1-4ba0-a64e-aed3f6cc4ed8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:46.032350 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-087926c2-75e1-48f8-b69c-a882f7fa8e7d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:46.040844 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-087926c2-75e1-48f8-b69c-a882f7fa8e7d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:46.041087 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-892a20ad-9df1-4ba0-a64e-aed3f6cc4ed8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:46.042361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-087926c2-75e1-48f8-b69c-a882f7fa8e7d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:46.043571 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-087926c2-75e1-48f8-b69c-a882f7fa8e7d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.160643 Jul 12 03:57:46.044180 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 448/858] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:45 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:46.049757 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-892a20ad-9df1-4ba0-a64e-aed3f6cc4ed8 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.166652 Jul 12 03:57:46.050481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 411/859] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:45 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:47.066356 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-90e47d82-d3af-414b-b782-ceafe9136192 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:47.067119 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-90e47d82-d3af-414b-b782-ceafe9136192 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:47.074131 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d3fa4f3d-878c-4732-b989-69bb551c2412 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:47.074945 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d3fa4f3d-878c-4732-b989-69bb551c2412 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:47.076179 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-90e47d82-d3af-414b-b782-ceafe9136192 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:47.076750 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-90e47d82-d3af-414b-b782-ceafe9136192 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:47.077714 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-90e47d82-d3af-414b-b782-ceafe9136192 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:47.078271 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-90e47d82-d3af-414b-b782-ceafe9136192 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:47.083393 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d3fa4f3d-878c-4732-b989-69bb551c2412 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:47.083951 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d3fa4f3d-878c-4732-b989-69bb551c2412 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:47.084938 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d3fa4f3d-878c-4732-b989-69bb551c2412 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:47.085470 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d3fa4f3d-878c-4732-b989-69bb551c2412 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:47.219117 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-90e47d82-d3af-414b-b782-ceafe9136192 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:47.225289 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d3fa4f3d-878c-4732-b989-69bb551c2412 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:47.227203 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-90e47d82-d3af-414b-b782-ceafe9136192 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:47.228753 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-90e47d82-d3af-414b-b782-ceafe9136192 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:47.229926 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-90e47d82-d3af-414b-b782-ceafe9136192 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.170549 Jul 12 03:57:47.230530 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 449/860] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:47 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:47.232926 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d3fa4f3d-878c-4732-b989-69bb551c2412 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.163640 Jul 12 03:57:47.233475 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 412/861] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:47 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:48.265119 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1f525ca9-80de-40e8-9e43-86e0f4a543f6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:48.267178 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-25cbc390-bb4b-4457-a8eb-5c4e23720e3c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:48.268291 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-25cbc390-bb4b-4457-a8eb-5c4e23720e3c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:48.269331 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1f525ca9-80de-40e8-9e43-86e0f4a543f6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:48.277791 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1f525ca9-80de-40e8-9e43-86e0f4a543f6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:48.278477 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1f525ca9-80de-40e8-9e43-86e0f4a543f6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:48.279249 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1f525ca9-80de-40e8-9e43-86e0f4a543f6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:48.279837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1f525ca9-80de-40e8-9e43-86e0f4a543f6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:48.279954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25cbc390-bb4b-4457-a8eb-5c4e23720e3c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:48.280439 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25cbc390-bb4b-4457-a8eb-5c4e23720e3c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:48.281283 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25cbc390-bb4b-4457-a8eb-5c4e23720e3c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:48.282001 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25cbc390-bb4b-4457-a8eb-5c4e23720e3c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:48.429783 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1f525ca9-80de-40e8-9e43-86e0f4a543f6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:48.439308 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-25cbc390-bb4b-4457-a8eb-5c4e23720e3c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:48.440938 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1f525ca9-80de-40e8-9e43-86e0f4a543f6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:48.442922 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1f525ca9-80de-40e8-9e43-86e0f4a543f6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:48.444212 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1f525ca9-80de-40e8-9e43-86e0f4a543f6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.183182 Jul 12 03:57:48.445290 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 450/862] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:48 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:48.452493 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-53e3a6ec-6b30-4ba5-957e-b6b5a23a282a req-115c4c6b-8514-40f5-994c-8a472953d028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0", "name": "network-vif-plugged", "status": "completed", "tag": "b4d13628-bffc-4297-8cf1-0d24b7c4bea0"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:57:48.458349 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-25cbc390-bb4b-4457-a8eb-5c4e23720e3c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.200950 Jul 12 03:57:48.458943 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 413/863] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:48 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:48.463084 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-53e3a6ec-6b30-4ba5-957e-b6b5a23a282a req-115c4c6b-8514-40f5-994c-8a472953d028 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:48.463530 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-53e3a6ec-6b30-4ba5-957e-b6b5a23a282a req-115c4c6b-8514-40f5-994c-8a472953d028 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:48.477658 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-53e3a6ec-6b30-4ba5-957e-b6b5a23a282a req-115c4c6b-8514-40f5-994c-8a472953d028 service nova] Creating event network-vif-plugged:b4d13628-bffc-4297-8cf1-0d24b7c4bea0 for instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 on hv-cinder-84773 Jul 12 03:57:48.484020 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-53e3a6ec-6b30-4ba5-957e-b6b5a23a282a req-115c4c6b-8514-40f5-994c-8a472953d028 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037241 Jul 12 03:57:48.484738 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 451/864] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:57:49.467594 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0c12c0e5-2d73-4264-8963-1ef2773ef6f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:49.468657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0c12c0e5-2d73-4264-8963-1ef2773ef6f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:49.472454 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=47 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:57:49.480613 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-631c95e6-0eb9-430c-8a12-dd0047572df2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:49.481457 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0c12c0e5-2d73-4264-8963-1ef2773ef6f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:49.481674 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-631c95e6-0eb9-430c-8a12-dd0047572df2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:49.482246 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0c12c0e5-2d73-4264-8963-1ef2773ef6f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:49.483478 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0c12c0e5-2d73-4264-8963-1ef2773ef6f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:49.484230 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0c12c0e5-2d73-4264-8963-1ef2773ef6f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:49.491055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-631c95e6-0eb9-430c-8a12-dd0047572df2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:49.491498 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-631c95e6-0eb9-430c-8a12-dd0047572df2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:49.492300 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-631c95e6-0eb9-430c-8a12-dd0047572df2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:49.492725 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-631c95e6-0eb9-430c-8a12-dd0047572df2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:49.618481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0c12c0e5-2d73-4264-8963-1ef2773ef6f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:49.622196 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-631c95e6-0eb9-430c-8a12-dd0047572df2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:49.626579 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0c12c0e5-2d73-4264-8963-1ef2773ef6f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:49.628343 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0c12c0e5-2d73-4264-8963-1ef2773ef6f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:49.629491 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0c12c0e5-2d73-4264-8963-1ef2773ef6f9 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.168818 Jul 12 03:57:49.629739 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-631c95e6-0eb9-430c-8a12-dd0047572df2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.157401 Jul 12 03:57:49.630037 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 414/865] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:49 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:49.630340 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 452/866] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:49 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:50.643710 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:57:50.644563 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=10 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:57:50.647143 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1f5dcace-33c9-492c-8486-c58653a97ae0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:50.647867 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1f5dcace-33c9-492c-8486-c58653a97ae0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:50.649534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0ff76db2-7b0b-4363-b763-6621c0c16ae4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:50.650306 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:57:50.650465 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0ff76db2-7b0b-4363-b763-6621c0c16ae4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:50.656632 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1f5dcace-33c9-492c-8486-c58653a97ae0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:50.657080 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1f5dcace-33c9-492c-8486-c58653a97ae0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:50.657874 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1f5dcace-33c9-492c-8486-c58653a97ae0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:50.657987 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0ff76db2-7b0b-4363-b763-6621c0c16ae4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:50.658319 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1f5dcace-33c9-492c-8486-c58653a97ae0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:50.658434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0ff76db2-7b0b-4363-b763-6621c0c16ae4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:50.659129 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0ff76db2-7b0b-4363-b763-6621c0c16ae4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:50.659706 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0ff76db2-7b0b-4363-b763-6621c0c16ae4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:50.788783 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1f5dcace-33c9-492c-8486-c58653a97ae0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:50.793554 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0ff76db2-7b0b-4363-b763-6621c0c16ae4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:50.796942 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1f5dcace-33c9-492c-8486-c58653a97ae0 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.154127 Jul 12 03:57:50.797563 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 415/867] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:50 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:50.802051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0ff76db2-7b0b-4363-b763-6621c0c16ae4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:50.803582 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0ff76db2-7b0b-4363-b763-6621c0c16ae4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:50.804783 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0ff76db2-7b0b-4363-b763-6621c0c16ae4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.161979 Jul 12 03:57:50.805337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 453/868] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:50 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:51.814559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e299eec3-7e9f-4be0-af2c-6375496d4ce7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:51.815202 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e299eec3-7e9f-4be0-af2c-6375496d4ce7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:51.822294 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e299eec3-7e9f-4be0-af2c-6375496d4ce7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:51.822715 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c0d64e8a-08ce-4072-964d-398466b9b474 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:51.823210 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e299eec3-7e9f-4be0-af2c-6375496d4ce7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:51.823316 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c0d64e8a-08ce-4072-964d-398466b9b474 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:51.823495 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e299eec3-7e9f-4be0-af2c-6375496d4ce7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:51.823928 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e299eec3-7e9f-4be0-af2c-6375496d4ce7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:51.832556 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c0d64e8a-08ce-4072-964d-398466b9b474 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:51.833008 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c0d64e8a-08ce-4072-964d-398466b9b474 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:51.833874 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c0d64e8a-08ce-4072-964d-398466b9b474 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:51.834391 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c0d64e8a-08ce-4072-964d-398466b9b474 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:51.960532 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e299eec3-7e9f-4be0-af2c-6375496d4ce7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:51.969037 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e299eec3-7e9f-4be0-af2c-6375496d4ce7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.158380 Jul 12 03:57:51.969631 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 416/869] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:51 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:51.970065 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c0d64e8a-08ce-4072-964d-398466b9b474 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:51.978546 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c0d64e8a-08ce-4072-964d-398466b9b474 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:51.980086 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c0d64e8a-08ce-4072-964d-398466b9b474 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:51.981289 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c0d64e8a-08ce-4072-964d-398466b9b474 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.162512 Jul 12 03:57:51.981848 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 454/870] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:51 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:52.986699 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c6761d30-7050-4018-b46d-da3abf8bb4e1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:52.987316 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c6761d30-7050-4018-b46d-da3abf8bb4e1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:52.994417 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c6761d30-7050-4018-b46d-da3abf8bb4e1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:52.994868 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c6761d30-7050-4018-b46d-da3abf8bb4e1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:52.995669 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c6761d30-7050-4018-b46d-da3abf8bb4e1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:52.996140 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c6761d30-7050-4018-b46d-da3abf8bb4e1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:53.002065 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-fdde0e0f-251e-44a9-9984-a3fa60920864 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:53.003315 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-fdde0e0f-251e-44a9-9984-a3fa60920864 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:53.010351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fdde0e0f-251e-44a9-9984-a3fa60920864 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:53.010801 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fdde0e0f-251e-44a9-9984-a3fa60920864 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:53.011576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fdde0e0f-251e-44a9-9984-a3fa60920864 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:53.012043 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fdde0e0f-251e-44a9-9984-a3fa60920864 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:53.130466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c6761d30-7050-4018-b46d-da3abf8bb4e1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:53.138100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c6761d30-7050-4018-b46d-da3abf8bb4e1 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.155442 Jul 12 03:57:53.138667 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 417/871] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:52 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:53.143140 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-fdde0e0f-251e-44a9-9984-a3fa60920864 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:53.151780 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-fdde0e0f-251e-44a9-9984-a3fa60920864 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:53.153427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-fdde0e0f-251e-44a9-9984-a3fa60920864 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:53.154583 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-fdde0e0f-251e-44a9-9984-a3fa60920864 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.156456 Jul 12 03:57:53.155137 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 455/872] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:52 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:54.159743 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a85988e1-85c1-4d24-a029-ec7ec6ceebc7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:54.160781 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a85988e1-85c1-4d24-a029-ec7ec6ceebc7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:54.172269 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a85988e1-85c1-4d24-a029-ec7ec6ceebc7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:54.173004 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a85988e1-85c1-4d24-a029-ec7ec6ceebc7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:54.174260 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a85988e1-85c1-4d24-a029-ec7ec6ceebc7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:54.175098 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a85988e1-85c1-4d24-a029-ec7ec6ceebc7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:54.176268 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1d9c8b4f-a296-4e83-86dc-ce3efcad46db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:54.176881 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1d9c8b4f-a296-4e83-86dc-ce3efcad46db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:54.183746 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d9c8b4f-a296-4e83-86dc-ce3efcad46db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:54.184254 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d9c8b4f-a296-4e83-86dc-ce3efcad46db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:54.185033 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d9c8b4f-a296-4e83-86dc-ce3efcad46db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:54.185469 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1d9c8b4f-a296-4e83-86dc-ce3efcad46db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:54.307307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a85988e1-85c1-4d24-a029-ec7ec6ceebc7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:54.315073 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a85988e1-85c1-4d24-a029-ec7ec6ceebc7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.161805 Jul 12 03:57:54.315764 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 418/873] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:54 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:54.320261 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1d9c8b4f-a296-4e83-86dc-ce3efcad46db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:54.331027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1d9c8b4f-a296-4e83-86dc-ce3efcad46db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:54.333645 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1d9c8b4f-a296-4e83-86dc-ce3efcad46db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:54.335461 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1d9c8b4f-a296-4e83-86dc-ce3efcad46db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.165001 Jul 12 03:57:54.336299 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 456/874] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:54 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:55.336165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-209dcc44-5342-4602-8c76-1a582962a772 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:55.337081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-209dcc44-5342-4602-8c76-1a582962a772 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:55.347956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-209dcc44-5342-4602-8c76-1a582962a772 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:55.348497 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-209dcc44-5342-4602-8c76-1a582962a772 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:55.349257 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-209dcc44-5342-4602-8c76-1a582962a772 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:55.349682 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-209dcc44-5342-4602-8c76-1a582962a772 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:55.358097 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-031d4118-3f51-48b8-b2c4-f48933f9df83 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:55.358715 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-031d4118-3f51-48b8-b2c4-f48933f9df83 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:55.365876 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-031d4118-3f51-48b8-b2c4-f48933f9df83 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:55.366334 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-031d4118-3f51-48b8-b2c4-f48933f9df83 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:55.367117 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-031d4118-3f51-48b8-b2c4-f48933f9df83 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:55.367554 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-031d4118-3f51-48b8-b2c4-f48933f9df83 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:55.490879 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-209dcc44-5342-4602-8c76-1a582962a772 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:55.498984 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-209dcc44-5342-4602-8c76-1a582962a772 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.169269 Jul 12 03:57:55.499563 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 419/875] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:55 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:55.505167 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-031d4118-3f51-48b8-b2c4-f48933f9df83 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:55.513213 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-031d4118-3f51-48b8-b2c4-f48933f9df83 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:55.514706 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-031d4118-3f51-48b8-b2c4-f48933f9df83 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:55.515853 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-031d4118-3f51-48b8-b2c4-f48933f9df83 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.161808 Jul 12 03:57:55.516516 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 457/876] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:55 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:56.515361 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6bd2414d-fcfa-474c-9151-906fb2f59d7f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:56.516033 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6bd2414d-fcfa-474c-9151-906fb2f59d7f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:56.522831 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6bd2414d-fcfa-474c-9151-906fb2f59d7f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:56.523274 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6bd2414d-fcfa-474c-9151-906fb2f59d7f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:56.524030 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6bd2414d-fcfa-474c-9151-906fb2f59d7f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:56.524460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6bd2414d-fcfa-474c-9151-906fb2f59d7f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:56.534867 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f34eb3a4-2912-47a6-a8fe-7b2bad767c63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:56.535483 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f34eb3a4-2912-47a6-a8fe-7b2bad767c63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:56.537999 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:57:56.543793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f34eb3a4-2912-47a6-a8fe-7b2bad767c63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:56.544276 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f34eb3a4-2912-47a6-a8fe-7b2bad767c63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:56.545056 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f34eb3a4-2912-47a6-a8fe-7b2bad767c63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:56.545731 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f34eb3a4-2912-47a6-a8fe-7b2bad767c63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:56.655926 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6bd2414d-fcfa-474c-9151-906fb2f59d7f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:56.663620 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6bd2414d-fcfa-474c-9151-906fb2f59d7f tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.152063 Jul 12 03:57:56.664205 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 420/877] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:56 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:56.681256 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f34eb3a4-2912-47a6-a8fe-7b2bad767c63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:56.689265 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f34eb3a4-2912-47a6-a8fe-7b2bad767c63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:56.691005 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f34eb3a4-2912-47a6-a8fe-7b2bad767c63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:56.692221 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f34eb3a4-2912-47a6-a8fe-7b2bad767c63 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.161367 Jul 12 03:57:56.692772 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 458/878] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:56 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:57.681551 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ea7538d8-6f3a-4115-a9c3-8447356d84f2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:57.682132 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ea7538d8-6f3a-4115-a9c3-8447356d84f2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:57.688740 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ea7538d8-6f3a-4115-a9c3-8447356d84f2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:57.689185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ea7538d8-6f3a-4115-a9c3-8447356d84f2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:57.689926 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ea7538d8-6f3a-4115-a9c3-8447356d84f2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:57.690327 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ea7538d8-6f3a-4115-a9c3-8447356d84f2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:57.710355 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d93bc258-f374-4048-8f9e-8d25040e4588 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:57.710946 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d93bc258-f374-4048-8f9e-8d25040e4588 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:57.717316 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d93bc258-f374-4048-8f9e-8d25040e4588 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:57.717761 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d93bc258-f374-4048-8f9e-8d25040e4588 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:57.718523 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d93bc258-f374-4048-8f9e-8d25040e4588 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:57.718953 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d93bc258-f374-4048-8f9e-8d25040e4588 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:57.820862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ea7538d8-6f3a-4115-a9c3-8447356d84f2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:57.828361 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ea7538d8-6f3a-4115-a9c3-8447356d84f2 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1363 microversion: 2.1 time: 0.150779 Jul 12 03:57:57.828935 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 421/879] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:57 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:57.850825 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d93bc258-f374-4048-8f9e-8d25040e4588 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:57.858869 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d93bc258-f374-4048-8f9e-8d25040e4588 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:57.860432 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d93bc258-f374-4048-8f9e-8d25040e4588 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:57.861630 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d93bc258-f374-4048-8f9e-8d25040e4588 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.155754 Jul 12 03:57:57.862166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 459/880] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:57 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:58.844578 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d561596b-7305-4802-b1f0-0e8f744b001b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:58.845567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d561596b-7305-4802-b1f0-0e8f744b001b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:58.852695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d561596b-7305-4802-b1f0-0e8f744b001b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:58.853137 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d561596b-7305-4802-b1f0-0e8f744b001b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:58.853895 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d561596b-7305-4802-b1f0-0e8f744b001b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:58.854320 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d561596b-7305-4802-b1f0-0e8f744b001b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:58.879919 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b57630d6-1ad0-403b-9daf-e813e98dffd7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:58.880973 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b57630d6-1ad0-403b-9daf-e813e98dffd7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:58.887948 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b57630d6-1ad0-403b-9daf-e813e98dffd7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:58.888569 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b57630d6-1ad0-403b-9daf-e813e98dffd7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:58.889195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b57630d6-1ad0-403b-9daf-e813e98dffd7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:58.889621 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b57630d6-1ad0-403b-9daf-e813e98dffd7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:59.031691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b57630d6-1ad0-403b-9daf-e813e98dffd7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:59.040874 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b57630d6-1ad0-403b-9daf-e813e98dffd7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:59.042377 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b57630d6-1ad0-403b-9daf-e813e98dffd7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:59.043628 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b57630d6-1ad0-403b-9daf-e813e98dffd7 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.167628 Jul 12 03:57:59.044269 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 460/881] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:57:58 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:57:59.253362 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d561596b-7305-4802-b1f0-0e8f744b001b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:57:59.264733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d561596b-7305-4802-b1f0-0e8f744b001b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1549 microversion: 2.1 time: 0.423756 Jul 12 03:57:59.265585 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 422/882] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:57:58 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1549 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:57:59.282538 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0d81d3b2-9781-4f02-a239-ea21d4915738 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:57:59.283063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0d81d3b2-9781-4f02-a239-ea21d4915738 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:57:59.290722 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d81d3b2-9781-4f02-a239-ea21d4915738 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:59.291465 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d81d3b2-9781-4f02-a239-ea21d4915738 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:59.292352 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d81d3b2-9781-4f02-a239-ea21d4915738 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:57:59.292966 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d81d3b2-9781-4f02-a239-ea21d4915738 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:57:59.378128 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0d81d3b2-9781-4f02-a239-ea21d4915738 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099357 Jul 12 03:57:59.378846 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 461/883] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 03:57:59 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:58:00.062112 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4a7cc8e8-5dcf-4f04-8460-e2f44b2167db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:00.063486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4a7cc8e8-5dcf-4f04-8460-e2f44b2167db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:00.072075 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4a7cc8e8-5dcf-4f04-8460-e2f44b2167db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:00.072527 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4a7cc8e8-5dcf-4f04-8460-e2f44b2167db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:00.073313 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4a7cc8e8-5dcf-4f04-8460-e2f44b2167db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:00.073748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4a7cc8e8-5dcf-4f04-8460-e2f44b2167db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:00.213054 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4a7cc8e8-5dcf-4f04-8460-e2f44b2167db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:00.223325 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4a7cc8e8-5dcf-4f04-8460-e2f44b2167db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:00.225181 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4a7cc8e8-5dcf-4f04-8460-e2f44b2167db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:00.227915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4a7cc8e8-5dcf-4f04-8460-e2f44b2167db tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1745 microversion: 2.20 time: 0.169837 Jul 12 03:58:00.228628 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 423/884] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:00 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:00.329402 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-b3df167c-6bf4-4217-a3a6-dbbc1b0c5d9f req-07e36957-fe7f-4343-ac26-061cea51843b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0", "tag": "b4d13628-bffc-4297-8cf1-0d24b7c4bea0"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:58:00.337546 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-b3df167c-6bf4-4217-a3a6-dbbc1b0c5d9f req-07e36957-fe7f-4343-ac26-061cea51843b service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:00.337993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-b3df167c-6bf4-4217-a3a6-dbbc1b0c5d9f req-07e36957-fe7f-4343-ac26-061cea51843b service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:00.349224 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-b3df167c-6bf4-4217-a3a6-dbbc1b0c5d9f req-07e36957-fe7f-4343-ac26-061cea51843b service nova] Creating event network-changed:b4d13628-bffc-4297-8cf1-0d24b7c4bea0 for instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 on hv-cinder-84773 Jul 12 03:58:00.354602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-b3df167c-6bf4-4217-a3a6-dbbc1b0c5d9f req-07e36957-fe7f-4343-ac26-061cea51843b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029360 Jul 12 03:58:00.355316 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 462/885] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:58:01.248741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-23106770-89c2-4ffb-9ed8-b1a840cd2172 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:01.249310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-23106770-89c2-4ffb-9ed8-b1a840cd2172 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:01.255739 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-23106770-89c2-4ffb-9ed8-b1a840cd2172 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:01.256220 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-23106770-89c2-4ffb-9ed8-b1a840cd2172 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:01.256991 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-23106770-89c2-4ffb-9ed8-b1a840cd2172 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:01.257417 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-23106770-89c2-4ffb-9ed8-b1a840cd2172 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:01.401886 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-23106770-89c2-4ffb-9ed8-b1a840cd2172 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:01.410383 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-23106770-89c2-4ffb-9ed8-b1a840cd2172 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:01.412128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-23106770-89c2-4ffb-9ed8-b1a840cd2172 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:01.413406 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-23106770-89c2-4ffb-9ed8-b1a840cd2172 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1745 microversion: 2.20 time: 0.168820 Jul 12 03:58:01.413934 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 424/886] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:01 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:02.436031 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1103d3bc-e924-4bda-ab9a-3c7d17337d1f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:02.436756 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1103d3bc-e924-4bda-ab9a-3c7d17337d1f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:02.443483 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1103d3bc-e924-4bda-ab9a-3c7d17337d1f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:02.443937 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1103d3bc-e924-4bda-ab9a-3c7d17337d1f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:02.444768 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1103d3bc-e924-4bda-ab9a-3c7d17337d1f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:02.445187 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1103d3bc-e924-4bda-ab9a-3c7d17337d1f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:02.445942 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-0c00a96d-3926-4cb0-91a5-0ef415300f40 req-056c8b24-e47a-4abc-8167-ac201904b104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63", "name": "network-vif-plugged", "status": "completed", "tag": "17836774-6562-4ed2-9a30-cc38e71017de"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:58:02.456977 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-0c00a96d-3926-4cb0-91a5-0ef415300f40 req-056c8b24-e47a-4abc-8167-ac201904b104 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:02.457492 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-0c00a96d-3926-4cb0-91a5-0ef415300f40 req-056c8b24-e47a-4abc-8167-ac201904b104 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:02.470085 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-0c00a96d-3926-4cb0-91a5-0ef415300f40 req-056c8b24-e47a-4abc-8167-ac201904b104 service nova] Creating event network-vif-plugged:17836774-6562-4ed2-9a30-cc38e71017de for instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 on hv-cinder-84773 Jul 12 03:58:02.475322 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-0c00a96d-3926-4cb0-91a5-0ef415300f40 req-056c8b24-e47a-4abc-8167-ac201904b104 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033412 Jul 12 03:58:02.476034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 425/887] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:58:02.577637 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1103d3bc-e924-4bda-ab9a-3c7d17337d1f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:02.589924 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1103d3bc-e924-4bda-ab9a-3c7d17337d1f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:02.592425 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1103d3bc-e924-4bda-ab9a-3c7d17337d1f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:02.593597 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1103d3bc-e924-4bda-ab9a-3c7d17337d1f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1745 microversion: 2.20 time: 0.162605 Jul 12 03:58:02.594146 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 463/888] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:02 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:03.615731 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c098655e-e4e8-4bab-bda4-bcb596479cc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:03.616460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c098655e-e4e8-4bab-bda4-bcb596479cc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:03.623602 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c098655e-e4e8-4bab-bda4-bcb596479cc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:03.624055 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c098655e-e4e8-4bab-bda4-bcb596479cc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:03.624854 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c098655e-e4e8-4bab-bda4-bcb596479cc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:03.625291 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c098655e-e4e8-4bab-bda4-bcb596479cc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:03.769619 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c098655e-e4e8-4bab-bda4-bcb596479cc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:03.778180 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c098655e-e4e8-4bab-bda4-bcb596479cc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:03.779694 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c098655e-e4e8-4bab-bda4-bcb596479cc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:03.780891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c098655e-e4e8-4bab-bda4-bcb596479cc8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1745 microversion: 2.20 time: 0.170693 Jul 12 03:58:03.781459 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 426/889] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:03 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:04.803526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cd2f9082-a697-4843-8dc3-a19c8aa5701c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:04.804226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-cd2f9082-a697-4843-8dc3-a19c8aa5701c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:04.811249 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd2f9082-a697-4843-8dc3-a19c8aa5701c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:04.811957 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd2f9082-a697-4843-8dc3-a19c8aa5701c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:04.812831 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd2f9082-a697-4843-8dc3-a19c8aa5701c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:04.813587 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd2f9082-a697-4843-8dc3-a19c8aa5701c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:04.986216 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cd2f9082-a697-4843-8dc3-a19c8aa5701c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:04.993137 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:58:04.996531 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cd2f9082-a697-4843-8dc3-a19c8aa5701c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:04.998251 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cd2f9082-a697-4843-8dc3-a19c8aa5701c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:04.999694 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cd2f9082-a697-4843-8dc3-a19c8aa5701c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1740 microversion: 2.20 time: 0.200492 Jul 12 03:58:05.010785 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 464/890] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:04 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:06.019228 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2d25cae3-cfad-4e7f-a0dc-eac3f7a076d3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:06.019965 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-2d25cae3-cfad-4e7f-a0dc-eac3f7a076d3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:06.029776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2d25cae3-cfad-4e7f-a0dc-eac3f7a076d3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:06.031232 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2d25cae3-cfad-4e7f-a0dc-eac3f7a076d3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:06.032285 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2d25cae3-cfad-4e7f-a0dc-eac3f7a076d3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:06.033075 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2d25cae3-cfad-4e7f-a0dc-eac3f7a076d3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:06.181670 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-2d25cae3-cfad-4e7f-a0dc-eac3f7a076d3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:06.190183 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-2d25cae3-cfad-4e7f-a0dc-eac3f7a076d3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:06.191979 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-2d25cae3-cfad-4e7f-a0dc-eac3f7a076d3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:06.193177 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-2d25cae3-cfad-4e7f-a0dc-eac3f7a076d3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1740 microversion: 2.20 time: 0.178172 Jul 12 03:58:06.193738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 427/891] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:06 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:07.212199 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-24b8edf0-04fa-4fb0-b6c2-4a899cfc4a90 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:07.212873 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-24b8edf0-04fa-4fb0-b6c2-4a899cfc4a90 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:07.220035 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-24b8edf0-04fa-4fb0-b6c2-4a899cfc4a90 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:07.220487 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-24b8edf0-04fa-4fb0-b6c2-4a899cfc4a90 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:07.221269 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-24b8edf0-04fa-4fb0-b6c2-4a899cfc4a90 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:07.221712 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-24b8edf0-04fa-4fb0-b6c2-4a899cfc4a90 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:07.381593 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-24b8edf0-04fa-4fb0-b6c2-4a899cfc4a90 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:07.390544 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-24b8edf0-04fa-4fb0-b6c2-4a899cfc4a90 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:07.396566 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-24b8edf0-04fa-4fb0-b6c2-4a899cfc4a90 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:07.396566 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-24b8edf0-04fa-4fb0-b6c2-4a899cfc4a90 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1740 microversion: 2.20 time: 0.186094 Jul 12 03:58:07.396566 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 465/892] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:07 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:08.415632 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5a5abe2e-d823-49a6-b223-7b4bf5d0b91d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:08.416240 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5a5abe2e-d823-49a6-b223-7b4bf5d0b91d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:08.423985 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5a5abe2e-d823-49a6-b223-7b4bf5d0b91d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:08.424708 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5a5abe2e-d823-49a6-b223-7b4bf5d0b91d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:08.425866 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5a5abe2e-d823-49a6-b223-7b4bf5d0b91d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:08.426304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5a5abe2e-d823-49a6-b223-7b4bf5d0b91d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:08.430809 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=100 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:58:08.572606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5a5abe2e-d823-49a6-b223-7b4bf5d0b91d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:08.581107 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5a5abe2e-d823-49a6-b223-7b4bf5d0b91d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:08.582672 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5a5abe2e-d823-49a6-b223-7b4bf5d0b91d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:08.583891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5a5abe2e-d823-49a6-b223-7b4bf5d0b91d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1740 microversion: 2.20 time: 0.172358 Jul 12 03:58:08.595580 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 428/893] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:08 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:09.602353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1fbab3f4-9f46-4b1d-b55b-a352a2393616 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:09.602986 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1fbab3f4-9f46-4b1d-b55b-a352a2393616 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:09.610005 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1fbab3f4-9f46-4b1d-b55b-a352a2393616 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:09.610787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1fbab3f4-9f46-4b1d-b55b-a352a2393616 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:09.611834 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1fbab3f4-9f46-4b1d-b55b-a352a2393616 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:09.612386 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1fbab3f4-9f46-4b1d-b55b-a352a2393616 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:09.810024 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1fbab3f4-9f46-4b1d-b55b-a352a2393616 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:09.819899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1fbab3f4-9f46-4b1d-b55b-a352a2393616 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:09.821462 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1fbab3f4-9f46-4b1d-b55b-a352a2393616 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:09.822666 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1fbab3f4-9f46-4b1d-b55b-a352a2393616 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1740 microversion: 2.20 time: 0.224175 Jul 12 03:58:09.823235 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 466/894] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:09 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:10.842266 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f2dc2367-f817-4726-83c1-d3572ef7cf4b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:10.843552 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f2dc2367-f817-4726-83c1-d3572ef7cf4b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:10.850263 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f2dc2367-f817-4726-83c1-d3572ef7cf4b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:10.850694 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f2dc2367-f817-4726-83c1-d3572ef7cf4b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:10.851688 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f2dc2367-f817-4726-83c1-d3572ef7cf4b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:10.852332 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f2dc2367-f817-4726-83c1-d3572ef7cf4b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:11.009164 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f2dc2367-f817-4726-83c1-d3572ef7cf4b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:11.017786 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f2dc2367-f817-4726-83c1-d3572ef7cf4b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:11.019590 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f2dc2367-f817-4726-83c1-d3572ef7cf4b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:11.021039 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f2dc2367-f817-4726-83c1-d3572ef7cf4b tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1740 microversion: 2.20 time: 0.182966 Jul 12 03:58:11.021794 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 429/895] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:10 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:12.042300 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4ffc4beb-a75f-4775-885c-f841049310d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:12.043715 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4ffc4beb-a75f-4775-885c-f841049310d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:12.050465 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4ffc4beb-a75f-4775-885c-f841049310d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:12.051234 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4ffc4beb-a75f-4775-885c-f841049310d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:12.052285 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4ffc4beb-a75f-4775-885c-f841049310d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:12.052807 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4ffc4beb-a75f-4775-885c-f841049310d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:12.215585 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4ffc4beb-a75f-4775-885c-f841049310d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:12.224252 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4ffc4beb-a75f-4775-885c-f841049310d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:12.225761 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4ffc4beb-a75f-4775-885c-f841049310d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:12.226955 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4ffc4beb-a75f-4775-885c-f841049310d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1740 microversion: 2.20 time: 0.188667 Jul 12 03:58:12.228408 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 467/896] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:12 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:13.246450 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-affbb47a-8ddd-4418-a00c-b1c637d33320 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:13.247057 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-affbb47a-8ddd-4418-a00c-b1c637d33320 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:13.254354 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-affbb47a-8ddd-4418-a00c-b1c637d33320 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:13.254841 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-affbb47a-8ddd-4418-a00c-b1c637d33320 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:13.255605 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-affbb47a-8ddd-4418-a00c-b1c637d33320 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:13.256438 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-affbb47a-8ddd-4418-a00c-b1c637d33320 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:13.409115 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-affbb47a-8ddd-4418-a00c-b1c637d33320 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:13.420835 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-affbb47a-8ddd-4418-a00c-b1c637d33320 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:13.422342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-affbb47a-8ddd-4418-a00c-b1c637d33320 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:13.423502 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-affbb47a-8ddd-4418-a00c-b1c637d33320 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1740 microversion: 2.20 time: 0.181386 Jul 12 03:58:13.424196 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 430/897] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:13 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:14.441838 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-daa1092d-b914-4d6d-8c7d-cf1219d03c8d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:14.442451 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-daa1092d-b914-4d6d-8c7d-cf1219d03c8d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:14.449132 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-daa1092d-b914-4d6d-8c7d-cf1219d03c8d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:14.449774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-daa1092d-b914-4d6d-8c7d-cf1219d03c8d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:14.450954 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-daa1092d-b914-4d6d-8c7d-cf1219d03c8d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:14.451241 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-daa1092d-b914-4d6d-8c7d-cf1219d03c8d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:14.593695 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-daa1092d-b914-4d6d-8c7d-cf1219d03c8d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:14.603324 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-daa1092d-b914-4d6d-8c7d-cf1219d03c8d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:14.605134 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-daa1092d-b914-4d6d-8c7d-cf1219d03c8d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:14.606827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-daa1092d-b914-4d6d-8c7d-cf1219d03c8d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1722 microversion: 2.20 time: 0.168724 Jul 12 03:58:14.610061 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 468/898] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:14 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:15.626237 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-999204ad-7037-4784-a8b2-222bd0d7eef5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:15.626871 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-999204ad-7037-4784-a8b2-222bd0d7eef5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:15.636701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-999204ad-7037-4784-a8b2-222bd0d7eef5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:15.637154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-999204ad-7037-4784-a8b2-222bd0d7eef5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:15.637930 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-999204ad-7037-4784-a8b2-222bd0d7eef5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:15.638366 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-999204ad-7037-4784-a8b2-222bd0d7eef5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:15.781115 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-999204ad-7037-4784-a8b2-222bd0d7eef5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:15.790259 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-999204ad-7037-4784-a8b2-222bd0d7eef5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:15.791937 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-999204ad-7037-4784-a8b2-222bd0d7eef5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:15.793252 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-999204ad-7037-4784-a8b2-222bd0d7eef5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1722 microversion: 2.20 time: 0.171507 Jul 12 03:58:15.794062 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 431/899] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:15 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:16.811701 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c45bdcc4-203c-4a51-a8c5-abca9200250d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:16.812432 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c45bdcc4-203c-4a51-a8c5-abca9200250d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:16.819560 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c45bdcc4-203c-4a51-a8c5-abca9200250d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:16.820191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c45bdcc4-203c-4a51-a8c5-abca9200250d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:16.821108 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c45bdcc4-203c-4a51-a8c5-abca9200250d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:16.821904 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c45bdcc4-203c-4a51-a8c5-abca9200250d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:16.960381 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c45bdcc4-203c-4a51-a8c5-abca9200250d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:16.968965 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c45bdcc4-203c-4a51-a8c5-abca9200250d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:16.970526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c45bdcc4-203c-4a51-a8c5-abca9200250d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:16.971694 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c45bdcc4-203c-4a51-a8c5-abca9200250d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1722 microversion: 2.20 time: 0.164293 Jul 12 03:58:16.972586 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 469/900] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:16 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:17.990253 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-12e47385-bfa5-4020-b406-49d9cd4045ce tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:17.990938 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-12e47385-bfa5-4020-b406-49d9cd4045ce tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:17.997987 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-12e47385-bfa5-4020-b406-49d9cd4045ce tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:17.998402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-12e47385-bfa5-4020-b406-49d9cd4045ce tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:17.999192 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-12e47385-bfa5-4020-b406-49d9cd4045ce tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:17.999614 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-12e47385-bfa5-4020-b406-49d9cd4045ce tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:18.143371 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-12e47385-bfa5-4020-b406-49d9cd4045ce tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:18.151973 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-12e47385-bfa5-4020-b406-49d9cd4045ce tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:18.153598 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-12e47385-bfa5-4020-b406-49d9cd4045ce tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:18.154860 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-12e47385-bfa5-4020-b406-49d9cd4045ce tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1665 microversion: 2.20 time: 0.168657 Jul 12 03:58:18.155606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 432/901] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:17 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1665 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:18.172483 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-bea72d84-a0a5-4e98-9883-de9c5912116e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43e969dd-7182-4f79-bdf6-2eb38433cf04"}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:58:18.173542 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-bea72d84-a0a5-4e98-9883-de9c5912116e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:18.179780 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bea72d84-a0a5-4e98-9883-de9c5912116e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:18.180261 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bea72d84-a0a5-4e98-9883-de9c5912116e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:18.181016 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bea72d84-a0a5-4e98-9883-de9c5912116e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:18.181448 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bea72d84-a0a5-4e98-9883-de9c5912116e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:18.474537 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-7f45f3a9-189e-4fe8-9ae0-cb0f038b907c req-533d1c7f-c116-4462-b543-717f1bd02a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63", "name": "network-vif-unplugged", "status": "completed", "tag": "17836774-6562-4ed2-9a30-cc38e71017de"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:58:18.487039 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-7f45f3a9-189e-4fe8-9ae0-cb0f038b907c req-533d1c7f-c116-4462-b543-717f1bd02a67 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:18.487591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-7f45f3a9-189e-4fe8-9ae0-cb0f038b907c req-533d1c7f-c116-4462-b543-717f1bd02a67 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:18.496170 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-bea72d84-a0a5-4e98-9883-de9c5912116e tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "POST /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327616 Jul 12 03:58:18.501767 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 470/902] 10.222.0.20 () {62 vars in 1363 bytes} [Tue Jul 12 03:58:18 2022] POST /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 03:58:18.507388 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.compute.server_external_events [req-7f45f3a9-189e-4fe8-9ae0-cb0f038b907c req-533d1c7f-c116-4462-b543-717f1bd02a67 service nova] Unable to find a host for instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63. Dropping event network-vif-unplugged {{(pid=124435) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 03:58:18.508300 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-7f45f3a9-189e-4fe8-9ae0-cb0f038b907c req-533d1c7f-c116-4462-b543-717f1bd02a67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037972 Jul 12 03:58:18.509059 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 433/903] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 12 03:58:18.629538 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b6023256-7a98-4b48-a929-2bb7d1c13086 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:18.630034 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b6023256-7a98-4b48-a929-2bb7d1c13086 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:18.637069 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b6023256-7a98-4b48-a929-2bb7d1c13086 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:18.637520 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b6023256-7a98-4b48-a929-2bb7d1c13086 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:18.638299 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b6023256-7a98-4b48-a929-2bb7d1c13086 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:18.638739 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b6023256-7a98-4b48-a929-2bb7d1c13086 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:18.891771 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b6023256-7a98-4b48-a929-2bb7d1c13086 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/os-volume_attachments/43e969dd-7182-4f79-bdf6-2eb38433cf04" status: 202 len: 0 microversion: 2.20 time: 0.266170 Jul 12 03:58:18.892465 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 471/904] 10.222.0.20 () {60 vars in 1456 bytes} [Tue Jul 12 03:58:18 2022] DELETE /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/os-volume_attachments/43e969dd-7182-4f79-bdf6-2eb38433cf04 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 03:58:18.953604 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d6ee88c9-d89f-413c-bffe-3bb888e3fdf8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:58:18.954163 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d6ee88c9-d89f-413c-bffe-3bb888e3fdf8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:18.964318 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d6ee88c9-d89f-413c-bffe-3bb888e3fdf8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:18.964775 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d6ee88c9-d89f-413c-bffe-3bb888e3fdf8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:18.965545 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d6ee88c9-d89f-413c-bffe-3bb888e3fdf8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:18.966004 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d6ee88c9-d89f-413c-bffe-3bb888e3fdf8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:19.058985 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d6ee88c9-d89f-413c-bffe-3bb888e3fdf8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "POST /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/action" status: 202 len: 0 microversion: 2.20 time: 0.109658 Jul 12 03:58:19.059642 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 434/905] 10.222.0.20 () {62 vars in 1318 bytes} [Tue Jul 12 03:58:18 2022] POST /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:58:19.068689 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7f852059-74f3-4895-a5c9-5ed01f6157f4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:19.069774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7f852059-74f3-4895-a5c9-5ed01f6157f4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:19.075596 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7f852059-74f3-4895-a5c9-5ed01f6157f4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:19.076110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7f852059-74f3-4895-a5c9-5ed01f6157f4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:19.077138 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7f852059-74f3-4895-a5c9-5ed01f6157f4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:19.077587 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7f852059-74f3-4895-a5c9-5ed01f6157f4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:19.227393 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7f852059-74f3-4895-a5c9-5ed01f6157f4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:19.236640 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7f852059-74f3-4895-a5c9-5ed01f6157f4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:19.239296 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7f852059-74f3-4895-a5c9-5ed01f6157f4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:19.240273 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7f852059-74f3-4895-a5c9-5ed01f6157f4 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1673 microversion: 2.20 time: 0.176132 Jul 12 03:58:19.240831 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 472/906] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:19 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:58:20.259860 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c7174bd9-7543-4e77-8658-6288e43faa59 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:20.260500 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c7174bd9-7543-4e77-8658-6288e43faa59 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:20.263377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=44 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:58:20.268164 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c7174bd9-7543-4e77-8658-6288e43faa59 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:20.268605 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c7174bd9-7543-4e77-8658-6288e43faa59 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:20.269507 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c7174bd9-7543-4e77-8658-6288e43faa59 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:20.269859 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c7174bd9-7543-4e77-8658-6288e43faa59 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:20.422425 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c7174bd9-7543-4e77-8658-6288e43faa59 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:20.435399 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c7174bd9-7543-4e77-8658-6288e43faa59 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:20.437111 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c7174bd9-7543-4e77-8658-6288e43faa59 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:20.438713 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c7174bd9-7543-4e77-8658-6288e43faa59 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1673 microversion: 2.20 time: 0.183569 Jul 12 03:58:20.439502 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 435/907] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:20 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:21.457527 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7f7d9274-cf26-4924-8188-50e6be02c845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:21.458150 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7f7d9274-cf26-4924-8188-50e6be02c845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:21.465181 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7f7d9274-cf26-4924-8188-50e6be02c845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:21.465636 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7f7d9274-cf26-4924-8188-50e6be02c845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:21.466414 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7f7d9274-cf26-4924-8188-50e6be02c845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:21.466851 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7f7d9274-cf26-4924-8188-50e6be02c845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:21.601029 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7f7d9274-cf26-4924-8188-50e6be02c845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:21.609544 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7f7d9274-cf26-4924-8188-50e6be02c845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:21.611077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7f7d9274-cf26-4924-8188-50e6be02c845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:21.612313 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7f7d9274-cf26-4924-8188-50e6be02c845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.158881 Jul 12 03:58:21.613146 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 473/908] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:21 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:22.635031 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0e9060ca-25dc-4f0a-bc9f-1786a4584d9d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:22.636058 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0e9060ca-25dc-4f0a-bc9f-1786a4584d9d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:22.646254 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0e9060ca-25dc-4f0a-bc9f-1786a4584d9d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:22.646713 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0e9060ca-25dc-4f0a-bc9f-1786a4584d9d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:22.647452 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0e9060ca-25dc-4f0a-bc9f-1786a4584d9d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:22.647865 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0e9060ca-25dc-4f0a-bc9f-1786a4584d9d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:22.788991 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0e9060ca-25dc-4f0a-bc9f-1786a4584d9d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:22.797941 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0e9060ca-25dc-4f0a-bc9f-1786a4584d9d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:22.799454 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0e9060ca-25dc-4f0a-bc9f-1786a4584d9d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:22.800681 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0e9060ca-25dc-4f0a-bc9f-1786a4584d9d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.172080 Jul 12 03:58:22.801258 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 436/909] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:22 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:23.820974 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-fb31eaba-86a7-429e-b3fb-20b8d880d868 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:23.821595 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-fb31eaba-86a7-429e-b3fb-20b8d880d868 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:23.828585 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb31eaba-86a7-429e-b3fb-20b8d880d868 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:23.829069 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb31eaba-86a7-429e-b3fb-20b8d880d868 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:23.829819 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb31eaba-86a7-429e-b3fb-20b8d880d868 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:23.830257 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb31eaba-86a7-429e-b3fb-20b8d880d868 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:23.974389 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-fb31eaba-86a7-429e-b3fb-20b8d880d868 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:23.982649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-fb31eaba-86a7-429e-b3fb-20b8d880d868 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:23.984210 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-fb31eaba-86a7-429e-b3fb-20b8d880d868 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:23.985368 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-fb31eaba-86a7-429e-b3fb-20b8d880d868 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.169347 Jul 12 03:58:23.985915 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 474/910] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:23 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:25.003035 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6e65a902-7bd2-42a1-be15-7ef4d277822f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:25.003628 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6e65a902-7bd2-42a1-be15-7ef4d277822f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:25.010868 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6e65a902-7bd2-42a1-be15-7ef4d277822f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:25.011311 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6e65a902-7bd2-42a1-be15-7ef4d277822f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:25.012070 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6e65a902-7bd2-42a1-be15-7ef4d277822f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:25.012541 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6e65a902-7bd2-42a1-be15-7ef4d277822f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:25.159539 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6e65a902-7bd2-42a1-be15-7ef4d277822f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:25.168157 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6e65a902-7bd2-42a1-be15-7ef4d277822f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:25.169667 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6e65a902-7bd2-42a1-be15-7ef4d277822f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:25.170823 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6e65a902-7bd2-42a1-be15-7ef4d277822f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.171842 Jul 12 03:58:25.171391 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 437/911] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:24 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:26.189913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d38d8d2b-4a50-467f-88cd-6282f9b2a9c6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:26.190370 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d38d8d2b-4a50-467f-88cd-6282f9b2a9c6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:26.202020 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d38d8d2b-4a50-467f-88cd-6282f9b2a9c6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:26.202550 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d38d8d2b-4a50-467f-88cd-6282f9b2a9c6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:26.203484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d38d8d2b-4a50-467f-88cd-6282f9b2a9c6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:26.204019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d38d8d2b-4a50-467f-88cd-6282f9b2a9c6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:26.337970 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d38d8d2b-4a50-467f-88cd-6282f9b2a9c6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:26.346136 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d38d8d2b-4a50-467f-88cd-6282f9b2a9c6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:26.347633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d38d8d2b-4a50-467f-88cd-6282f9b2a9c6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:26.348827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d38d8d2b-4a50-467f-88cd-6282f9b2a9c6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.163267 Jul 12 03:58:26.349403 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 475/912] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:26 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:27.369459 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c07ab00f-87d9-4eb1-9ada-574ede97f845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:27.370520 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c07ab00f-87d9-4eb1-9ada-574ede97f845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:27.385393 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c07ab00f-87d9-4eb1-9ada-574ede97f845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:27.385848 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c07ab00f-87d9-4eb1-9ada-574ede97f845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:27.388544 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c07ab00f-87d9-4eb1-9ada-574ede97f845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:27.390760 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c07ab00f-87d9-4eb1-9ada-574ede97f845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:27.546095 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c07ab00f-87d9-4eb1-9ada-574ede97f845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:27.554543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c07ab00f-87d9-4eb1-9ada-574ede97f845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:27.556275 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c07ab00f-87d9-4eb1-9ada-574ede97f845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:27.557423 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c07ab00f-87d9-4eb1-9ada-574ede97f845 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.194601 Jul 12 03:58:27.557978 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 438/913] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:27 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:28.578185 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-775e7f3a-6ecf-4408-8703-c79de70d8701 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:28.578928 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-775e7f3a-6ecf-4408-8703-c79de70d8701 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:28.581878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=36 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:58:28.588144 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-775e7f3a-6ecf-4408-8703-c79de70d8701 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:28.588598 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-775e7f3a-6ecf-4408-8703-c79de70d8701 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:28.589379 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-775e7f3a-6ecf-4408-8703-c79de70d8701 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:28.589811 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-775e7f3a-6ecf-4408-8703-c79de70d8701 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:28.594037 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:58:28.752229 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-775e7f3a-6ecf-4408-8703-c79de70d8701 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:28.760300 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-775e7f3a-6ecf-4408-8703-c79de70d8701 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:28.761793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-775e7f3a-6ecf-4408-8703-c79de70d8701 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:28.762936 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-775e7f3a-6ecf-4408-8703-c79de70d8701 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.189822 Jul 12 03:58:28.763485 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 476/914] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:28 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:29.781950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0ef40159-4ed1-4ae3-af2f-df36a0dcff4c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:29.782685 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0ef40159-4ed1-4ae3-af2f-df36a0dcff4c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:29.790656 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0ef40159-4ed1-4ae3-af2f-df36a0dcff4c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:29.791152 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0ef40159-4ed1-4ae3-af2f-df36a0dcff4c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:29.792382 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0ef40159-4ed1-4ae3-af2f-df36a0dcff4c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:29.793054 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0ef40159-4ed1-4ae3-af2f-df36a0dcff4c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:29.928075 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0ef40159-4ed1-4ae3-af2f-df36a0dcff4c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:29.936624 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0ef40159-4ed1-4ae3-af2f-df36a0dcff4c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:29.938133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0ef40159-4ed1-4ae3-af2f-df36a0dcff4c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:29.939663 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0ef40159-4ed1-4ae3-af2f-df36a0dcff4c tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.161807 Jul 12 03:58:29.940743 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 439/915] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:29 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:30.961129 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-dbd9f3c2-bb6c-46b4-99d3-44733957baa2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:30.962508 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-dbd9f3c2-bb6c-46b4-99d3-44733957baa2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:30.970568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dbd9f3c2-bb6c-46b4-99d3-44733957baa2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:30.971384 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dbd9f3c2-bb6c-46b4-99d3-44733957baa2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:30.972504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dbd9f3c2-bb6c-46b4-99d3-44733957baa2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:30.973192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dbd9f3c2-bb6c-46b4-99d3-44733957baa2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:31.362950 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-dbd9f3c2-bb6c-46b4-99d3-44733957baa2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:31.371251 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-dbd9f3c2-bb6c-46b4-99d3-44733957baa2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:31.372820 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-dbd9f3c2-bb6c-46b4-99d3-44733957baa2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:31.373964 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-dbd9f3c2-bb6c-46b4-99d3-44733957baa2 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.416838 Jul 12 03:58:31.374525 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 477/916] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:30 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:32.397832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1a12f22d-1228-40ea-9b5b-f8f356fe4c65 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:32.398473 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1a12f22d-1228-40ea-9b5b-f8f356fe4c65 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:32.407143 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1a12f22d-1228-40ea-9b5b-f8f356fe4c65 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:32.407661 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1a12f22d-1228-40ea-9b5b-f8f356fe4c65 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:32.408637 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1a12f22d-1228-40ea-9b5b-f8f356fe4c65 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:32.409470 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1a12f22d-1228-40ea-9b5b-f8f356fe4c65 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:32.543648 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1a12f22d-1228-40ea-9b5b-f8f356fe4c65 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:32.551774 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1a12f22d-1228-40ea-9b5b-f8f356fe4c65 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:32.553313 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1a12f22d-1228-40ea-9b5b-f8f356fe4c65 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:32.554473 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1a12f22d-1228-40ea-9b5b-f8f356fe4c65 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.165653 Jul 12 03:58:32.555044 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 440/917] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:32 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:33.575754 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cd5c16b1-8fe0-4530-8854-f52c487277c3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:33.577010 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-cd5c16b1-8fe0-4530-8854-f52c487277c3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:33.584787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd5c16b1-8fe0-4530-8854-f52c487277c3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:33.585565 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd5c16b1-8fe0-4530-8854-f52c487277c3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:33.586343 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd5c16b1-8fe0-4530-8854-f52c487277c3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:33.586786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd5c16b1-8fe0-4530-8854-f52c487277c3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:33.719833 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cd5c16b1-8fe0-4530-8854-f52c487277c3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:33.728096 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cd5c16b1-8fe0-4530-8854-f52c487277c3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:33.729649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cd5c16b1-8fe0-4530-8854-f52c487277c3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:33.730804 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cd5c16b1-8fe0-4530-8854-f52c487277c3 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.160061 Jul 12 03:58:33.731383 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 478/918] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:33 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:34.749192 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-45a04cd9-1112-42d3-b8c7-25b07531583f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:34.749775 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-45a04cd9-1112-42d3-b8c7-25b07531583f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:34.756735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-45a04cd9-1112-42d3-b8c7-25b07531583f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:34.757203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-45a04cd9-1112-42d3-b8c7-25b07531583f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:34.758049 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-45a04cd9-1112-42d3-b8c7-25b07531583f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:34.758480 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-45a04cd9-1112-42d3-b8c7-25b07531583f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:34.893950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-45a04cd9-1112-42d3-b8c7-25b07531583f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:34.903291 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-45a04cd9-1112-42d3-b8c7-25b07531583f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:34.905222 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-45a04cd9-1112-42d3-b8c7-25b07531583f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:34.906665 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-45a04cd9-1112-42d3-b8c7-25b07531583f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.161665 Jul 12 03:58:34.917885 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 441/919] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:34 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:35.224096 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-173928681", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-359074052", "security_groups": [{"name": "tempest-secgroup-smoke-360543779"}], "block_device_mapping_v2": [{"uuid": "456f51f0-0135-452e-82c7-1813203543e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb793af7-088d-44b6-bebd-8609e6743321"}]}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:58:35.370227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.network.neutron [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] validate_networks() for [('cb793af7-088d-44b6-bebd-8609e6743321', None, None, None, None, None)] {{(pid=124434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:58:35.800804 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Flavor limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:58:35.801236 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Image limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:58:35.801711 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Flavor pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:58:35.802123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Image pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:58:35.802534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:58:35.811801 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:35.812543 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:35.813516 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:35.814118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:35.832891 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Getting quotas for project 99d9e85c63234c77889f856bf95288f5. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:58:35.837641 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Getting quotas for user 46d5c3f98d924538a34c4b3a57fcac14 and project 99d9e85c63234c77889f856bf95288f5. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:58:35.895576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Going to run 1 instances... {{(pid=124434) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:58:35.898357 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='456f51f0-0135-452e-82c7-1813203543e1',volume_size=None,volume_type=None)] {{(pid=124434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:58:35.927027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0d44a7d1-23f9-4588-b05c-8dbfceebde91 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:35.927964 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0d44a7d1-23f9-4588-b05c-8dbfceebde91 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:35.955360 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0d44a7d1-23f9-4588-b05c-8dbfceebde91 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:35.955810 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0d44a7d1-23f9-4588-b05c-8dbfceebde91 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:35.962578 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0d44a7d1-23f9-4588-b05c-8dbfceebde91 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:35.963029 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0d44a7d1-23f9-4588-b05c-8dbfceebde91 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:36.115714 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-431e16ad-f102-410b-b8e7-e5080140face tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.900310 Jul 12 03:58:36.116385 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 479/920] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:58:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 03:58:36.128679 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8efc7c98-4549-472f-a9a7-8d978a75d0e0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:36.129478 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8efc7c98-4549-472f-a9a7-8d978a75d0e0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:36.174970 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0d44a7d1-23f9-4588-b05c-8dbfceebde91 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:36.199035 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0d44a7d1-23f9-4588-b05c-8dbfceebde91 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:36.206291 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0d44a7d1-23f9-4588-b05c-8dbfceebde91 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:36.210076 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0d44a7d1-23f9-4588-b05c-8dbfceebde91 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.286294 Jul 12 03:58:36.211387 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 442/921] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:35 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:36.230177 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8efc7c98-4549-472f-a9a7-8d978a75d0e0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:36.240050 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8efc7c98-4549-472f-a9a7-8d978a75d0e0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1093 microversion: 2.1 time: 0.117261 Jul 12 03:58:36.242408 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 480/922] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:36 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1093 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:37.231155 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-70393d2d-c13b-453e-b8de-df32214e8c69 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:37.231899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-70393d2d-c13b-453e-b8de-df32214e8c69 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:37.238773 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-70393d2d-c13b-453e-b8de-df32214e8c69 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:37.239209 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-70393d2d-c13b-453e-b8de-df32214e8c69 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:37.239991 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-70393d2d-c13b-453e-b8de-df32214e8c69 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:37.240449 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-70393d2d-c13b-453e-b8de-df32214e8c69 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:37.259975 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-96bead66-9ba7-4407-9f73-f481fe58005a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:37.261313 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-96bead66-9ba7-4407-9f73-f481fe58005a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:37.269498 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-96bead66-9ba7-4407-9f73-f481fe58005a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:37.270008 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-96bead66-9ba7-4407-9f73-f481fe58005a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:37.271291 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-96bead66-9ba7-4407-9f73-f481fe58005a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:37.271735 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-96bead66-9ba7-4407-9f73-f481fe58005a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:37.353409 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-96bead66-9ba7-4407-9f73-f481fe58005a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:37.363701 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-96bead66-9ba7-4407-9f73-f481fe58005a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1143 microversion: 2.1 time: 0.108140 Jul 12 03:58:37.370556 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 481/923] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:37 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1143 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 03:58:37.398436 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-70393d2d-c13b-453e-b8de-df32214e8c69 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:37.406889 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-70393d2d-c13b-453e-b8de-df32214e8c69 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:37.408432 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-70393d2d-c13b-453e-b8de-df32214e8c69 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:37.409572 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-70393d2d-c13b-453e-b8de-df32214e8c69 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.182795 Jul 12 03:58:37.410302 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 443/924] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:37 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:38.381331 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-39e30cd3-8a48-463c-924d-f452b281d4ec tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:38.382379 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-39e30cd3-8a48-463c-924d-f452b281d4ec tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:38.389953 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-39e30cd3-8a48-463c-924d-f452b281d4ec tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:38.390359 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-39e30cd3-8a48-463c-924d-f452b281d4ec tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:38.391153 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-39e30cd3-8a48-463c-924d-f452b281d4ec tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:38.391577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-39e30cd3-8a48-463c-924d-f452b281d4ec tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:38.426849 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8abdf14e-0bd9-4969-85ff-b1b8a96b1bef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:38.427398 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8abdf14e-0bd9-4969-85ff-b1b8a96b1bef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:38.434351 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8abdf14e-0bd9-4969-85ff-b1b8a96b1bef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:38.434766 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8abdf14e-0bd9-4969-85ff-b1b8a96b1bef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:38.435562 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8abdf14e-0bd9-4969-85ff-b1b8a96b1bef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:38.436020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8abdf14e-0bd9-4969-85ff-b1b8a96b1bef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:38.454846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:58:38.455904 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-39e30cd3-8a48-463c-924d-f452b281d4ec tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:38.465492 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-39e30cd3-8a48-463c-924d-f452b281d4ec tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1143 microversion: 2.1 time: 0.088328 Jul 12 03:58:38.466534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 482/925] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:38 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:38.578878 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8abdf14e-0bd9-4969-85ff-b1b8a96b1bef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:38.587152 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8abdf14e-0bd9-4969-85ff-b1b8a96b1bef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:38.588699 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8abdf14e-0bd9-4969-85ff-b1b8a96b1bef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:38.589862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8abdf14e-0bd9-4969-85ff-b1b8a96b1bef tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.167079 Jul 12 03:58:38.590474 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 444/926] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:38 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:39.482763 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-aff0643f-9791-4619-8e75-b5f89e681101 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:39.484151 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-aff0643f-9791-4619-8e75-b5f89e681101 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:39.490867 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-aff0643f-9791-4619-8e75-b5f89e681101 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:39.491324 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-aff0643f-9791-4619-8e75-b5f89e681101 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:39.492121 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-aff0643f-9791-4619-8e75-b5f89e681101 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:39.492534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-aff0643f-9791-4619-8e75-b5f89e681101 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:39.556274 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-aff0643f-9791-4619-8e75-b5f89e681101 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:39.564445 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-aff0643f-9791-4619-8e75-b5f89e681101 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1143 microversion: 2.1 time: 0.085487 Jul 12 03:58:39.565281 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 483/927] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:39 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:39.608146 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1d43d035-3153-4816-a031-a920cacd8ca8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:39.608827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1d43d035-3153-4816-a031-a920cacd8ca8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:39.616250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1d43d035-3153-4816-a031-a920cacd8ca8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:39.616668 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1d43d035-3153-4816-a031-a920cacd8ca8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:39.617579 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1d43d035-3153-4816-a031-a920cacd8ca8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:39.617925 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1d43d035-3153-4816-a031-a920cacd8ca8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:39.763499 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1d43d035-3153-4816-a031-a920cacd8ca8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:39.771460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1d43d035-3153-4816-a031-a920cacd8ca8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:39.772985 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1d43d035-3153-4816-a031-a920cacd8ca8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:39.774202 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1d43d035-3153-4816-a031-a920cacd8ca8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.170015 Jul 12 03:58:39.774956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 445/928] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:39 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:40.581459 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-df1383c6-67cd-4215-9099-fa171cf6f230 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:40.582077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-df1383c6-67cd-4215-9099-fa171cf6f230 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:40.589027 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-df1383c6-67cd-4215-9099-fa171cf6f230 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:40.589483 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-df1383c6-67cd-4215-9099-fa171cf6f230 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:40.590254 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-df1383c6-67cd-4215-9099-fa171cf6f230 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:40.590777 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-df1383c6-67cd-4215-9099-fa171cf6f230 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:40.653963 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-df1383c6-67cd-4215-9099-fa171cf6f230 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:40.662419 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-df1383c6-67cd-4215-9099-fa171cf6f230 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1135 microversion: 2.1 time: 0.084838 Jul 12 03:58:40.663213 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 484/929] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:40 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1135 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:40.793910 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b45ebb9f-7bc2-496c-83e7-1ffd5a47f9a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:40.794976 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b45ebb9f-7bc2-496c-83e7-1ffd5a47f9a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:40.801809 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b45ebb9f-7bc2-496c-83e7-1ffd5a47f9a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:40.802256 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b45ebb9f-7bc2-496c-83e7-1ffd5a47f9a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:40.803027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b45ebb9f-7bc2-496c-83e7-1ffd5a47f9a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:40.803457 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b45ebb9f-7bc2-496c-83e7-1ffd5a47f9a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:40.942992 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b45ebb9f-7bc2-496c-83e7-1ffd5a47f9a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:40.950313 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b45ebb9f-7bc2-496c-83e7-1ffd5a47f9a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:40.951814 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b45ebb9f-7bc2-496c-83e7-1ffd5a47f9a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:40.953035 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b45ebb9f-7bc2-496c-83e7-1ffd5a47f9a1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.163843 Jul 12 03:58:40.953722 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 446/930] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:40 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:41.679973 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f83351b2-85d2-42b4-b42c-fd969b2f9961 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:41.680701 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f83351b2-85d2-42b4-b42c-fd969b2f9961 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:41.687594 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f83351b2-85d2-42b4-b42c-fd969b2f9961 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:41.688086 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f83351b2-85d2-42b4-b42c-fd969b2f9961 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:41.688845 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f83351b2-85d2-42b4-b42c-fd969b2f9961 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:41.689284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f83351b2-85d2-42b4-b42c-fd969b2f9961 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:41.753852 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f83351b2-85d2-42b4-b42c-fd969b2f9961 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:41.761519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f83351b2-85d2-42b4-b42c-fd969b2f9961 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1135 microversion: 2.1 time: 0.085510 Jul 12 03:58:41.762076 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 485/931] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:41 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1135 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:41.970830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-700ba72b-8dcd-4934-a71d-d6a50a598313 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:41.971438 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-700ba72b-8dcd-4934-a71d-d6a50a598313 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:41.978383 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-700ba72b-8dcd-4934-a71d-d6a50a598313 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:41.978835 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-700ba72b-8dcd-4934-a71d-d6a50a598313 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:41.979604 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-700ba72b-8dcd-4934-a71d-d6a50a598313 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:41.980052 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-700ba72b-8dcd-4934-a71d-d6a50a598313 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:42.112230 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-700ba72b-8dcd-4934-a71d-d6a50a598313 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:42.120567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-700ba72b-8dcd-4934-a71d-d6a50a598313 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:42.122080 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-700ba72b-8dcd-4934-a71d-d6a50a598313 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:42.123292 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-700ba72b-8dcd-4934-a71d-d6a50a598313 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.156431 Jul 12 03:58:42.123884 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 447/932] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:41 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:42.778211 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8740edcb-44be-412a-b79d-b2e64495ccf9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:42.778784 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8740edcb-44be-412a-b79d-b2e64495ccf9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:42.785538 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8740edcb-44be-412a-b79d-b2e64495ccf9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:42.785975 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8740edcb-44be-412a-b79d-b2e64495ccf9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:42.786738 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8740edcb-44be-412a-b79d-b2e64495ccf9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:42.787163 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8740edcb-44be-412a-b79d-b2e64495ccf9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:42.853774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8740edcb-44be-412a-b79d-b2e64495ccf9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:42.863535 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8740edcb-44be-412a-b79d-b2e64495ccf9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1135 microversion: 2.1 time: 0.088387 Jul 12 03:58:42.863535 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 486/933] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:42 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1135 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:43.141263 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-19deb999-183c-4989-931c-bfc8391a9dec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:43.142010 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-19deb999-183c-4989-931c-bfc8391a9dec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:43.149236 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-19deb999-183c-4989-931c-bfc8391a9dec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:43.149811 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-19deb999-183c-4989-931c-bfc8391a9dec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:43.150601 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-19deb999-183c-4989-931c-bfc8391a9dec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:43.151215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-19deb999-183c-4989-931c-bfc8391a9dec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:43.290686 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-19deb999-183c-4989-931c-bfc8391a9dec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:43.299613 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-19deb999-183c-4989-931c-bfc8391a9dec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:43.301140 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-19deb999-183c-4989-931c-bfc8391a9dec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:43.302318 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-19deb999-183c-4989-931c-bfc8391a9dec tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.165030 Jul 12 03:58:43.302871 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 448/934] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:43 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:43.879577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6e0b4643-3224-452e-87ae-69ea0e078aad tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:43.880166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-6e0b4643-3224-452e-87ae-69ea0e078aad tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:43.887803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6e0b4643-3224-452e-87ae-69ea0e078aad tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:43.888277 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6e0b4643-3224-452e-87ae-69ea0e078aad tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:43.889078 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6e0b4643-3224-452e-87ae-69ea0e078aad tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:43.889502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6e0b4643-3224-452e-87ae-69ea0e078aad tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:43.954262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-6e0b4643-3224-452e-87ae-69ea0e078aad tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:43.962946 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-6e0b4643-3224-452e-87ae-69ea0e078aad tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1209 microversion: 2.1 time: 0.087895 Jul 12 03:58:43.963897 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 487/935] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:43 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:44.320840 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ffb2fdf4-8a7e-4baa-a1b0-654fb103ae2a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:44.321392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ffb2fdf4-8a7e-4baa-a1b0-654fb103ae2a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:44.328194 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ffb2fdf4-8a7e-4baa-a1b0-654fb103ae2a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:44.328683 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ffb2fdf4-8a7e-4baa-a1b0-654fb103ae2a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:44.329432 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ffb2fdf4-8a7e-4baa-a1b0-654fb103ae2a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:44.329856 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ffb2fdf4-8a7e-4baa-a1b0-654fb103ae2a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:44.545974 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ffb2fdf4-8a7e-4baa-a1b0-654fb103ae2a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:44.557951 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ffb2fdf4-8a7e-4baa-a1b0-654fb103ae2a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:44.559480 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ffb2fdf4-8a7e-4baa-a1b0-654fb103ae2a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:44.560695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ffb2fdf4-8a7e-4baa-a1b0-654fb103ae2a tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.243833 Jul 12 03:58:44.561252 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 449/936] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:44 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:44.981035 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1332b8e0-1aff-4f0b-a456-2937d70bd8d5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:44.982089 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1332b8e0-1aff-4f0b-a456-2937d70bd8d5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:44.990760 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1332b8e0-1aff-4f0b-a456-2937d70bd8d5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:44.991216 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1332b8e0-1aff-4f0b-a456-2937d70bd8d5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:44.991991 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1332b8e0-1aff-4f0b-a456-2937d70bd8d5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:44.992560 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1332b8e0-1aff-4f0b-a456-2937d70bd8d5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:45.148455 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1332b8e0-1aff-4f0b-a456-2937d70bd8d5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:45.160178 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1332b8e0-1aff-4f0b-a456-2937d70bd8d5 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1276 microversion: 2.1 time: 0.183413 Jul 12 03:58:45.169653 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 488/937] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:44 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:45.221425 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-ed9ec33a-c37c-46fe-b714-5c8c5c113ed0 req-87080f3e-4e25-46fa-bdf0-8541d61da88e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4933f1e-effd-46fc-8b69-a50bdc419106", "tag": "b54c3cd0-0543-4605-8bcb-366ec7d32882"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:58:45.241622 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-ed9ec33a-c37c-46fe-b714-5c8c5c113ed0 req-87080f3e-4e25-46fa-bdf0-8541d61da88e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:45.242192 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-ed9ec33a-c37c-46fe-b714-5c8c5c113ed0 req-87080f3e-4e25-46fa-bdf0-8541d61da88e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:45.257095 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-ed9ec33a-c37c-46fe-b714-5c8c5c113ed0 req-87080f3e-4e25-46fa-bdf0-8541d61da88e service nova] Creating event network-changed:b54c3cd0-0543-4605-8bcb-366ec7d32882 for instance e4933f1e-effd-46fc-8b69-a50bdc419106 on hv-cinder-84773 Jul 12 03:58:45.263306 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-ed9ec33a-c37c-46fe-b714-5c8c5c113ed0 req-87080f3e-4e25-46fa-bdf0-8541d61da88e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048253 Jul 12 03:58:45.264151 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 450/938] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:58:45.579728 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a2ee4c68-70e4-4a44-815d-6629ed5d54f5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:45.580360 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a2ee4c68-70e4-4a44-815d-6629ed5d54f5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:45.586785 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a2ee4c68-70e4-4a44-815d-6629ed5d54f5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:45.587228 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a2ee4c68-70e4-4a44-815d-6629ed5d54f5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:45.587989 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a2ee4c68-70e4-4a44-815d-6629ed5d54f5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:45.588546 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a2ee4c68-70e4-4a44-815d-6629ed5d54f5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:45.723755 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a2ee4c68-70e4-4a44-815d-6629ed5d54f5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:45.732766 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a2ee4c68-70e4-4a44-815d-6629ed5d54f5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:45.734280 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a2ee4c68-70e4-4a44-815d-6629ed5d54f5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:45.735457 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a2ee4c68-70e4-4a44-815d-6629ed5d54f5 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.159728 Jul 12 03:58:45.736126 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 489/939] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:45 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:46.178181 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b67001b4-7322-4f09-8e82-c7cdf26a4059 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:46.179075 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b67001b4-7322-4f09-8e82-c7cdf26a4059 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:46.186556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b67001b4-7322-4f09-8e82-c7cdf26a4059 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:46.187090 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b67001b4-7322-4f09-8e82-c7cdf26a4059 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:46.187932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b67001b4-7322-4f09-8e82-c7cdf26a4059 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:46.188454 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b67001b4-7322-4f09-8e82-c7cdf26a4059 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:46.390780 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b67001b4-7322-4f09-8e82-c7cdf26a4059 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:46.400286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b67001b4-7322-4f09-8e82-c7cdf26a4059 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1264 microversion: 2.1 time: 0.226751 Jul 12 03:58:46.400874 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 451/940] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:46 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:46.657089 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-3d4e3857-02e2-4709-8d35-87fe4b29cdc1 req-c8f377b7-17f1-4101-82ec-097428743c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63", "name": "network-vif-plugged", "status": "completed", "tag": "17836774-6562-4ed2-9a30-cc38e71017de"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:58:46.661201 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:58:46.663113 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=8 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:58:46.670362 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-3d4e3857-02e2-4709-8d35-87fe4b29cdc1 req-c8f377b7-17f1-4101-82ec-097428743c50 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:46.671061 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-3d4e3857-02e2-4709-8d35-87fe4b29cdc1 req-c8f377b7-17f1-4101-82ec-097428743c50 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:46.684165 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-3d4e3857-02e2-4709-8d35-87fe4b29cdc1 req-c8f377b7-17f1-4101-82ec-097428743c50 service nova] Creating event network-vif-plugged:17836774-6562-4ed2-9a30-cc38e71017de for instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 on hv-cinder-84773 Jul 12 03:58:46.689898 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-3d4e3857-02e2-4709-8d35-87fe4b29cdc1 req-c8f377b7-17f1-4101-82ec-097428743c50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037755 Jul 12 03:58:46.690780 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 490/941] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:58:46.754281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-539e48ef-0905-42f3-bb51-9a521d7e3ab8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:46.754937 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-539e48ef-0905-42f3-bb51-9a521d7e3ab8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:46.761994 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-539e48ef-0905-42f3-bb51-9a521d7e3ab8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:46.762443 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-539e48ef-0905-42f3-bb51-9a521d7e3ab8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:46.763217 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-539e48ef-0905-42f3-bb51-9a521d7e3ab8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:46.763868 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-539e48ef-0905-42f3-bb51-9a521d7e3ab8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:46.903506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-539e48ef-0905-42f3-bb51-9a521d7e3ab8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:46.911896 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-539e48ef-0905-42f3-bb51-9a521d7e3ab8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:46.913411 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-539e48ef-0905-42f3-bb51-9a521d7e3ab8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:46.914712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-539e48ef-0905-42f3-bb51-9a521d7e3ab8 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.164477 Jul 12 03:58:46.915276 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 452/942] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:46 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:47.422979 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-78a1531e-7214-43a7-9a4a-af1ee394c6af tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:47.424204 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-78a1531e-7214-43a7-9a4a-af1ee394c6af tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:47.434966 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78a1531e-7214-43a7-9a4a-af1ee394c6af tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:47.435722 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78a1531e-7214-43a7-9a4a-af1ee394c6af tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:47.437061 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78a1531e-7214-43a7-9a4a-af1ee394c6af tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:47.437802 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-78a1531e-7214-43a7-9a4a-af1ee394c6af tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:47.587267 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-78a1531e-7214-43a7-9a4a-af1ee394c6af tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:47.598427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-78a1531e-7214-43a7-9a4a-af1ee394c6af tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1264 microversion: 2.1 time: 0.182397 Jul 12 03:58:47.599146 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 491/943] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:47 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:47.933589 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-df0b1225-7331-4e66-a75d-1081a3d80354 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:47.934210 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-df0b1225-7331-4e66-a75d-1081a3d80354 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:47.941390 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-df0b1225-7331-4e66-a75d-1081a3d80354 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:47.941838 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-df0b1225-7331-4e66-a75d-1081a3d80354 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:47.942615 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-df0b1225-7331-4e66-a75d-1081a3d80354 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:47.943041 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-df0b1225-7331-4e66-a75d-1081a3d80354 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:48.074446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-df0b1225-7331-4e66-a75d-1081a3d80354 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:48.082835 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-df0b1225-7331-4e66-a75d-1081a3d80354 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:48.084445 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-df0b1225-7331-4e66-a75d-1081a3d80354 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:48.085659 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-df0b1225-7331-4e66-a75d-1081a3d80354 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.156173 Jul 12 03:58:48.086231 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 453/944] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:47 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:48.615024 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ef9894c3-de22-4f95-89e6-667edacdd4ac tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:48.615602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ef9894c3-de22-4f95-89e6-667edacdd4ac tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:48.622452 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ef9894c3-de22-4f95-89e6-667edacdd4ac tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:48.622910 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ef9894c3-de22-4f95-89e6-667edacdd4ac tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:48.623678 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ef9894c3-de22-4f95-89e6-667edacdd4ac tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:48.624145 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ef9894c3-de22-4f95-89e6-667edacdd4ac tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:48.759900 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ef9894c3-de22-4f95-89e6-667edacdd4ac tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:48.767798 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ef9894c3-de22-4f95-89e6-667edacdd4ac tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1264 microversion: 2.1 time: 0.156729 Jul 12 03:58:48.768393 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 492/945] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:48 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:49.108376 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d5cb4c5d-4882-4de4-8569-74975deaee20 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:49.109377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d5cb4c5d-4882-4de4-8569-74975deaee20 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:49.120518 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d5cb4c5d-4882-4de4-8569-74975deaee20 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:49.121272 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d5cb4c5d-4882-4de4-8569-74975deaee20 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:49.122542 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d5cb4c5d-4882-4de4-8569-74975deaee20 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:49.123271 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d5cb4c5d-4882-4de4-8569-74975deaee20 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:49.266143 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d5cb4c5d-4882-4de4-8569-74975deaee20 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:49.276154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d5cb4c5d-4882-4de4-8569-74975deaee20 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:49.278076 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d5cb4c5d-4882-4de4-8569-74975deaee20 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:49.279237 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d5cb4c5d-4882-4de4-8569-74975deaee20 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.177646 Jul 12 03:58:49.279799 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 454/946] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:49 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:49.785165 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-15ca5755-9950-4d0e-89aa-80d5f69b02c0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:49.785732 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-15ca5755-9950-4d0e-89aa-80d5f69b02c0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:49.793216 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-15ca5755-9950-4d0e-89aa-80d5f69b02c0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:49.793771 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-15ca5755-9950-4d0e-89aa-80d5f69b02c0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:49.794746 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-15ca5755-9950-4d0e-89aa-80d5f69b02c0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:49.795267 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-15ca5755-9950-4d0e-89aa-80d5f69b02c0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:49.943032 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-15ca5755-9950-4d0e-89aa-80d5f69b02c0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:49.950923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-15ca5755-9950-4d0e-89aa-80d5f69b02c0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1264 microversion: 2.1 time: 0.169754 Jul 12 03:58:49.951502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 493/947] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:49 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:50.298279 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ae6c2b08-2ba7-49e1-b320-9d11d829d388 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:50.298886 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ae6c2b08-2ba7-49e1-b320-9d11d829d388 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:50.300893 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=40 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:58:50.306556 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae6c2b08-2ba7-49e1-b320-9d11d829d388 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:50.306966 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae6c2b08-2ba7-49e1-b320-9d11d829d388 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:50.307723 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae6c2b08-2ba7-49e1-b320-9d11d829d388 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:50.308179 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae6c2b08-2ba7-49e1-b320-9d11d829d388 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:50.441211 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ae6c2b08-2ba7-49e1-b320-9d11d829d388 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:50.449595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ae6c2b08-2ba7-49e1-b320-9d11d829d388 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:50.451112 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ae6c2b08-2ba7-49e1-b320-9d11d829d388 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:50.452386 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ae6c2b08-2ba7-49e1-b320-9d11d829d388 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1731 microversion: 2.20 time: 0.158681 Jul 12 03:58:50.452957 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 455/948] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:50 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:50.966963 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e03129f4-ba3c-4963-9cef-b95791a258a9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:50.967575 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e03129f4-ba3c-4963-9cef-b95791a258a9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:50.974490 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e03129f4-ba3c-4963-9cef-b95791a258a9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:50.974929 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e03129f4-ba3c-4963-9cef-b95791a258a9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:50.975740 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e03129f4-ba3c-4963-9cef-b95791a258a9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:50.976210 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e03129f4-ba3c-4963-9cef-b95791a258a9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:51.110217 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e03129f4-ba3c-4963-9cef-b95791a258a9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:51.117871 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e03129f4-ba3c-4963-9cef-b95791a258a9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1264 microversion: 2.1 time: 0.154688 Jul 12 03:58:51.118420 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 494/949] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:50 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:51.474218 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-614301a1-3253-4ddb-bb59-246bf6489393 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:51.475159 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-614301a1-3253-4ddb-bb59-246bf6489393 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:51.482992 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-614301a1-3253-4ddb-bb59-246bf6489393 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:51.483439 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-614301a1-3253-4ddb-bb59-246bf6489393 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:51.484266 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-614301a1-3253-4ddb-bb59-246bf6489393 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:51.484691 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-614301a1-3253-4ddb-bb59-246bf6489393 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:51.619318 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-614301a1-3253-4ddb-bb59-246bf6489393 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:51.627657 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-614301a1-3253-4ddb-bb59-246bf6489393 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:51.629196 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-614301a1-3253-4ddb-bb59-246bf6489393 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:51.630347 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-614301a1-3253-4ddb-bb59-246bf6489393 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1718 microversion: 2.20 time: 0.162704 Jul 12 03:58:51.630919 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 456/950] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:58:51 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:58:52.137355 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0f761fcb-3f00-4bb9-be91-a0f666f693d8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:52.138042 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0f761fcb-3f00-4bb9-be91-a0f666f693d8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:52.145686 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0f761fcb-3f00-4bb9-be91-a0f666f693d8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:52.146183 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0f761fcb-3f00-4bb9-be91-a0f666f693d8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:52.147031 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0f761fcb-3f00-4bb9-be91-a0f666f693d8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:52.147560 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0f761fcb-3f00-4bb9-be91-a0f666f693d8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:52.151964 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=100 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:58:52.302315 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0f761fcb-3f00-4bb9-be91-a0f666f693d8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:52.311721 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0f761fcb-3f00-4bb9-be91-a0f666f693d8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1264 microversion: 2.1 time: 0.179549 Jul 12 03:58:52.312367 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 495/951] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:52 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:53.333496 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-14012844-a8b8-46ed-bf81-2f597e10ee50 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:53.334471 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-14012844-a8b8-46ed-bf81-2f597e10ee50 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:53.342915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-14012844-a8b8-46ed-bf81-2f597e10ee50 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:53.343357 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-14012844-a8b8-46ed-bf81-2f597e10ee50 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:53.344142 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-14012844-a8b8-46ed-bf81-2f597e10ee50 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:53.344567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-14012844-a8b8-46ed-bf81-2f597e10ee50 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:53.484845 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-14012844-a8b8-46ed-bf81-2f597e10ee50 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:53.492558 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-14012844-a8b8-46ed-bf81-2f597e10ee50 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1264 microversion: 2.1 time: 0.165495 Jul 12 03:58:53.493127 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 457/952] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:53 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:54.513753 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-45e88fac-aad5-4a82-9d94-bed55c35106e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:54.514715 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-45e88fac-aad5-4a82-9d94-bed55c35106e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:54.525816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-45e88fac-aad5-4a82-9d94-bed55c35106e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:54.526261 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-45e88fac-aad5-4a82-9d94-bed55c35106e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:54.527017 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-45e88fac-aad5-4a82-9d94-bed55c35106e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:54.527805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-45e88fac-aad5-4a82-9d94-bed55c35106e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:54.659969 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-45e88fac-aad5-4a82-9d94-bed55c35106e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:54.667622 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-45e88fac-aad5-4a82-9d94-bed55c35106e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1264 microversion: 2.1 time: 0.160447 Jul 12 03:58:54.678417 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 496/953] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:54 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:55.690529 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1d3eeece-c199-499f-9612-509a389f2c8b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:55.691373 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1d3eeece-c199-499f-9612-509a389f2c8b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:55.700830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1d3eeece-c199-499f-9612-509a389f2c8b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:55.701276 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1d3eeece-c199-499f-9612-509a389f2c8b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:55.702035 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1d3eeece-c199-499f-9612-509a389f2c8b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:55.702466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1d3eeece-c199-499f-9612-509a389f2c8b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:55.850207 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1d3eeece-c199-499f-9612-509a389f2c8b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:55.857877 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1d3eeece-c199-499f-9612-509a389f2c8b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1264 microversion: 2.1 time: 0.174022 Jul 12 03:58:55.858443 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 458/954] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:55 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:56.797745 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-33c9205f-a4f4-4e14-ba9f-10d49f726f4d req-da6fb67d-56a5-4fb3-8191-ef7353b0f453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4933f1e-effd-46fc-8b69-a50bdc419106", "name": "network-vif-plugged", "status": "completed", "tag": "b54c3cd0-0543-4605-8bcb-366ec7d32882"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:58:56.806560 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-33c9205f-a4f4-4e14-ba9f-10d49f726f4d req-da6fb67d-56a5-4fb3-8191-ef7353b0f453 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:56.807005 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-33c9205f-a4f4-4e14-ba9f-10d49f726f4d req-da6fb67d-56a5-4fb3-8191-ef7353b0f453 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:56.818298 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-33c9205f-a4f4-4e14-ba9f-10d49f726f4d req-da6fb67d-56a5-4fb3-8191-ef7353b0f453 service nova] Creating event network-vif-plugged:b54c3cd0-0543-4605-8bcb-366ec7d32882 for instance e4933f1e-effd-46fc-8b69-a50bdc419106 on hv-cinder-84773 Jul 12 03:58:56.823166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-33c9205f-a4f4-4e14-ba9f-10d49f726f4d req-da6fb67d-56a5-4fb3-8191-ef7353b0f453 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029822 Jul 12 03:58:56.823763 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 497/955] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:58:56.880513 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c168e99f-138d-4ebb-bbdd-e0a969a391bd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:56.881129 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c168e99f-138d-4ebb-bbdd-e0a969a391bd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:56.887964 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c168e99f-138d-4ebb-bbdd-e0a969a391bd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:56.888451 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c168e99f-138d-4ebb-bbdd-e0a969a391bd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:56.889559 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c168e99f-138d-4ebb-bbdd-e0a969a391bd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:56.890000 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c168e99f-138d-4ebb-bbdd-e0a969a391bd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:57.229591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c168e99f-138d-4ebb-bbdd-e0a969a391bd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:57.237349 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c168e99f-138d-4ebb-bbdd-e0a969a391bd tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1264 microversion: 2.1 time: 0.360811 Jul 12 03:58:57.237930 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 459/956] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:56 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1264 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:58.260086 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-29590cec-8a27-4ce7-bc86-b6e7eedc6ca8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:58.261295 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-29590cec-8a27-4ce7-bc86-b6e7eedc6ca8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:58.272074 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-29590cec-8a27-4ce7-bc86-b6e7eedc6ca8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:58.272829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-29590cec-8a27-4ce7-bc86-b6e7eedc6ca8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:58.274106 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-29590cec-8a27-4ce7-bc86-b6e7eedc6ca8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:58.274838 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-29590cec-8a27-4ce7-bc86-b6e7eedc6ca8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:58.418776 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-29590cec-8a27-4ce7-bc86-b6e7eedc6ca8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:58.426761 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-29590cec-8a27-4ce7-bc86-b6e7eedc6ca8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1264 microversion: 2.1 time: 0.174695 Jul 12 03:58:58.427336 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 498/957] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:58 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:59.447049 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1cc047b8-6bb1-41bd-a1b7-e2d7f13268e9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:59.447923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1cc047b8-6bb1-41bd-a1b7-e2d7f13268e9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:59.455399 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1cc047b8-6bb1-41bd-a1b7-e2d7f13268e9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:59.455915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1cc047b8-6bb1-41bd-a1b7-e2d7f13268e9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:59.456749 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1cc047b8-6bb1-41bd-a1b7-e2d7f13268e9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:59.457196 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1cc047b8-6bb1-41bd-a1b7-e2d7f13268e9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:59.594491 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1cc047b8-6bb1-41bd-a1b7-e2d7f13268e9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:59.602175 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1cc047b8-6bb1-41bd-a1b7-e2d7f13268e9 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1452 microversion: 2.1 time: 0.161913 Jul 12 03:58:59.602742 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 460/958] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:59 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:58:59.623746 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9eb64bc6-e86e-4db8-a497-8c78dffee5c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:58:59.624423 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-9eb64bc6-e86e-4db8-a497-8c78dffee5c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:58:59.627015 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:58:59.632773 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9eb64bc6-e86e-4db8-a497-8c78dffee5c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:59.633223 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9eb64bc6-e86e-4db8-a497-8c78dffee5c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:59.634015 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9eb64bc6-e86e-4db8-a497-8c78dffee5c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:58:59.634448 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-9eb64bc6-e86e-4db8-a497-8c78dffee5c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:58:59.782098 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9eb64bc6-e86e-4db8-a497-8c78dffee5c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:58:59.790372 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9eb64bc6-e86e-4db8-a497-8c78dffee5c1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1452 microversion: 2.1 time: 0.170491 Jul 12 03:58:59.790920 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 499/959] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:58:59 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:59:01.594278 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-825dda0a-665f-4c70-96e3-55a3f532485a req-68d6d184-4a39-435c-b2a2-b4d6050049f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4933f1e-effd-46fc-8b69-a50bdc419106", "tag": "b54c3cd0-0543-4605-8bcb-366ec7d32882"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:59:01.602563 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-825dda0a-665f-4c70-96e3-55a3f532485a req-68d6d184-4a39-435c-b2a2-b4d6050049f4 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:01.603009 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-825dda0a-665f-4c70-96e3-55a3f532485a req-68d6d184-4a39-435c-b2a2-b4d6050049f4 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:01.613990 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-825dda0a-665f-4c70-96e3-55a3f532485a req-68d6d184-4a39-435c-b2a2-b4d6050049f4 service nova] Creating event network-changed:b54c3cd0-0543-4605-8bcb-366ec7d32882 for instance e4933f1e-effd-46fc-8b69-a50bdc419106 on hv-cinder-84773 Jul 12 03:59:01.619639 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-825dda0a-665f-4c70-96e3-55a3f532485a req-68d6d184-4a39-435c-b2a2-b4d6050049f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029060 Jul 12 03:59:01.620450 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 461/960] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:02.763198 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2904ee92-bc96-4772-9d5c-5c4e6b3454c5 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1099857249"}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:59:02.764074 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2904ee92-bc96-4772-9d5c-5c4e6b3454c5 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:02.771938 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2904ee92-bc96-4772-9d5c-5c4e6b3454c5 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:02.772469 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2904ee92-bc96-4772-9d5c-5c4e6b3454c5 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:02.773249 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2904ee92-bc96-4772-9d5c-5c4e6b3454c5 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:02.773717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2904ee92-bc96-4772-9d5c-5c4e6b3454c5 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:02.908580 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.network.security_group_api [None req-2904ee92-bc96-4772-9d5c-5c4e6b3454c5 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Removing security group aedc2799-e553-47ba-9ab4-519912c8e3a2 from port 05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3 Jul 12 03:59:03.272921 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2904ee92-bc96-4772-9d5c-5c4e6b3454c5 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "POST /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/action" status: 202 len: 0 microversion: 2.1 time: 0.513716 Jul 12 03:59:03.275429 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 500/961] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 03:59:02 2022] POST /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:59:03.636979 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-28d96cad-5a0d-4856-924b-cbb529f7cbda req-1c8f60f7-78f1-4469-8780-117dca0ac132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc703cb-c9d3-4fce-a3af-2e7253cdb910", "tag": "05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:59:03.647318 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-28d96cad-5a0d-4856-924b-cbb529f7cbda req-1c8f60f7-78f1-4469-8780-117dca0ac132 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:03.647777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-28d96cad-5a0d-4856-924b-cbb529f7cbda req-1c8f60f7-78f1-4469-8780-117dca0ac132 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:03.659150 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-28d96cad-5a0d-4856-924b-cbb529f7cbda req-1c8f60f7-78f1-4469-8780-117dca0ac132 service nova] Creating event network-changed:05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3 for instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 on hv-cinder-84773 Jul 12 03:59:03.664620 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-28d96cad-5a0d-4856-924b-cbb529f7cbda req-1c8f60f7-78f1-4469-8780-117dca0ac132 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032429 Jul 12 03:59:03.665316 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 462/962] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:04.567327 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c568eb31-0066-4816-a017-286a26a0938f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:04.567883 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c568eb31-0066-4816-a017-286a26a0938f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:04.574184 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c568eb31-0066-4816-a017-286a26a0938f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:04.574621 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c568eb31-0066-4816-a017-286a26a0938f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:04.575376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c568eb31-0066-4816-a017-286a26a0938f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:04.575806 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c568eb31-0066-4816-a017-286a26a0938f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:04.655593 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-c568eb31-0066-4816-a017-286a26a0938f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lazy-loading 'services' on Instance uuid 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:59:04.731281 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c568eb31-0066-4816-a017-286a26a0938f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/os-volume_attachments/8eedbc6a-890f-4866-bc06-df0312210c08" status: 202 len: 0 microversion: 2.1 time: 0.168604 Jul 12 03:59:04.732207 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 501/963] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 03:59:04 2022] DELETE /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/os-volume_attachments/8eedbc6a-890f-4866-bc06-df0312210c08 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:59:04.741402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4b9e66b8-39a1-4462-86bb-6a31ebdcca27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:04.743803 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4b9e66b8-39a1-4462-86bb-6a31ebdcca27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:04.757245 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4b9e66b8-39a1-4462-86bb-6a31ebdcca27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:04.758800 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4b9e66b8-39a1-4462-86bb-6a31ebdcca27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:04.759622 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4b9e66b8-39a1-4462-86bb-6a31ebdcca27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:04.760221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4b9e66b8-39a1-4462-86bb-6a31ebdcca27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:04.762906 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=100 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:59:04.791956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4b9e66b8-39a1-4462-86bb-6a31ebdcca27 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055218 Jul 12 03:59:04.792776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 463/964] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 03:59:04 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:05.688123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-8a22af57-f319-461f-985e-d191f000d0f8 req-45211902-02b4-44ff-bb9a-9a2d32e94d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc703cb-c9d3-4fce-a3af-2e7253cdb910", "tag": "05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:59:05.700448 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-8a22af57-f319-461f-985e-d191f000d0f8 req-45211902-02b4-44ff-bb9a-9a2d32e94d66 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:05.700897 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-8a22af57-f319-461f-985e-d191f000d0f8 req-45211902-02b4-44ff-bb9a-9a2d32e94d66 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:05.711980 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-8a22af57-f319-461f-985e-d191f000d0f8 req-45211902-02b4-44ff-bb9a-9a2d32e94d66 service nova] Creating event network-changed:05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3 for instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 on hv-cinder-84773 Jul 12 03:59:05.717075 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-8a22af57-f319-461f-985e-d191f000d0f8 req-45211902-02b4-44ff-bb9a-9a2d32e94d66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037056 Jul 12 03:59:05.717754 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 502/965] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:05.805616 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f5460557-2d0b-41ea-8acf-f992a38b397b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:05.806664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f5460557-2d0b-41ea-8acf-f992a38b397b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:05.814452 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f5460557-2d0b-41ea-8acf-f992a38b397b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:05.815132 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f5460557-2d0b-41ea-8acf-f992a38b397b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:05.816595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f5460557-2d0b-41ea-8acf-f992a38b397b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:05.817036 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f5460557-2d0b-41ea-8acf-f992a38b397b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:05.854642 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f5460557-2d0b-41ea-8acf-f992a38b397b tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053762 Jul 12 03:59:05.855233 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 464/966] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 03:59:05 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 03:59:05.866007 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-67800b8d-62e5-472d-b3eb-7d3b79f25b19 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:05.866587 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-67800b8d-62e5-472d-b3eb-7d3b79f25b19 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:05.873440 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-67800b8d-62e5-472d-b3eb-7d3b79f25b19 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:05.873893 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-67800b8d-62e5-472d-b3eb-7d3b79f25b19 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:05.874854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-67800b8d-62e5-472d-b3eb-7d3b79f25b19 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:05.875298 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-67800b8d-62e5-472d-b3eb-7d3b79f25b19 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:06.114599 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-67800b8d-62e5-472d-b3eb-7d3b79f25b19 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] HTTP exception thrown: Instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 is not attached to volume 8eedbc6a-890f-4866-bc06-df0312210c08 Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-67800b8d-62e5-472d-b3eb-7d3b79f25b19 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Request method failure captured: Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: DELETE /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/os-volume_attachments/8eedbc6a-890f-4866-bc06-df0312210c08 HTTP/1.1 Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizPCZDnvJKsnStMf5wMBzymF-JxIDIWn4KGLsi-KdBsWiqY_bk4Yfgylut5DBPfrvncjnKZ1Grf3Y3necHFnZhUglqt4H-bZ2aKUe2h-ivkJJTdgmt5pGyH8uGrU74CoPZU8FP_7JJKPmOlgTKVpSY2PLOgiX5WLFG4CDH1jQz4DXy4c Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: b38d912121c64d5e887dc21e354b3cfd Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-TestMinimumBasicScenario-44349850 Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 03:59:06.117019 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 03:59:06.118737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b38d912121c64d5e887dc21e354b3cfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b38d912121c64d5e887dc21e354b3cfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b38d912121c64d5e887dc21e354b3cfd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b38d912121c64d5e887dc21e354b3cfd"}]}] Jul 12 03:59:06.118737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-TestMinimumBasicScenario-44349850 Jul 12 03:59:06.118737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: b38d912121c64d5e887dc21e354b3cfd Jul 12 03:59:06.118737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-TestMinimumBasicScenario-44349850 Jul 12 03:59:06.118737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-TestMinimumBasicScenario-44349850-project Jul 12 03:59:06.118737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 03:59:06.118737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 03:59:06.118737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 8701284390d345eabc027e05f9ac262b Jul 12 03:59:06.118737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-TestMinimumBasicScenario-44349850-project Jul 12 03:59:06.118737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 03:59:06.118737 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 is not attached to volume 8eedbc6a-890f-4866-bc06-df0312210c08 Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'server_id': '7cc703cb-c9d3-4fce-a3af-2e7253cdb910', 'id': '8eedbc6a-890f-4866-bc06-df0312210c08'} Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8eedbc6a-890f-4866-bc06-df0312210c08. Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:59:06.119607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 is not attached to volume 8eedbc6a-890f-4866-bc06-df0312210c08 Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 is not attached to volume 8eedbc6a-890f-4866-bc06-df0312210c08 Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:59:06.121238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-67800b8d-62e5-472d-b3eb-7d3b79f25b19 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Returning 404 to user: Instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 is not attached to volume 8eedbc6a-890f-4866-bc06-df0312210c08 {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:59:06.122400 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-67800b8d-62e5-472d-b3eb-7d3b79f25b19 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/os-volume_attachments/8eedbc6a-890f-4866-bc06-df0312210c08" status: 404 len: 154 microversion: 2.1 time: 0.257117 Jul 12 03:59:06.122400 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 503/967] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 03:59:05 2022] DELETE /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910/os-volume_attachments/8eedbc6a-890f-4866-bc06-df0312210c08 => generated 154 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:59:07.262722 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-cd01a317-e99b-4c46-b030-f0a26dda9715 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:07.263228 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-cd01a317-e99b-4c46-b030-f0a26dda9715 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:07.270319 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cd01a317-e99b-4c46-b030-f0a26dda9715 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:07.270764 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cd01a317-e99b-4c46-b030-f0a26dda9715 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:07.271533 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cd01a317-e99b-4c46-b030-f0a26dda9715 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:07.271968 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-cd01a317-e99b-4c46-b030-f0a26dda9715 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:07.297152 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-cd01a317-e99b-4c46-b030-f0a26dda9715 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:59:07.391930 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-cd01a317-e99b-4c46-b030-f0a26dda9715 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 204 len: 0 microversion: 2.1 time: 0.133271 Jul 12 03:59:07.392722 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 465/968] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 03:59:07 2022] DELETE /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 03:59:07.401078 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-81cc6b5d-0059-4a8a-8104-2d36f876d1e4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:07.401685 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-81cc6b5d-0059-4a8a-8104-2d36f876d1e4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:07.408809 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-81cc6b5d-0059-4a8a-8104-2d36f876d1e4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:07.409261 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-81cc6b5d-0059-4a8a-8104-2d36f876d1e4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:07.410088 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-81cc6b5d-0059-4a8a-8104-2d36f876d1e4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:07.410514 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-81cc6b5d-0059-4a8a-8104-2d36f876d1e4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:07.544669 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-81cc6b5d-0059-4a8a-8104-2d36f876d1e4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:07.552952 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-81cc6b5d-0059-4a8a-8104-2d36f876d1e4 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1554 microversion: 2.1 time: 0.155839 Jul 12 03:59:07.553521 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 504/969] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:59:07 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:59:08.575731 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ef892030-948c-4ed1-84ad-f4a0cc75c3fe tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:08.576949 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ef892030-948c-4ed1-84ad-f4a0cc75c3fe tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:08.587981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ef892030-948c-4ed1-84ad-f4a0cc75c3fe tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:08.588773 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ef892030-948c-4ed1-84ad-f4a0cc75c3fe tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:08.590047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ef892030-948c-4ed1-84ad-f4a0cc75c3fe tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:08.590761 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ef892030-948c-4ed1-84ad-f4a0cc75c3fe tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:08.733237 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ef892030-948c-4ed1-84ad-f4a0cc75c3fe tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:08.744885 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ef892030-948c-4ed1-84ad-f4a0cc75c3fe tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1554 microversion: 2.1 time: 0.176301 Jul 12 03:59:08.745486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 466/970] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:59:08 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:59:09.762506 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c687fa78-c5f9-4989-93bc-8c7abbd1c3b9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:09.763195 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c687fa78-c5f9-4989-93bc-8c7abbd1c3b9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:09.770192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c687fa78-c5f9-4989-93bc-8c7abbd1c3b9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:09.770650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c687fa78-c5f9-4989-93bc-8c7abbd1c3b9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:09.771427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c687fa78-c5f9-4989-93bc-8c7abbd1c3b9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:09.771871 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c687fa78-c5f9-4989-93bc-8c7abbd1c3b9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:09.906533 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c687fa78-c5f9-4989-93bc-8c7abbd1c3b9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8701284390d345eabc027e05f9ac262b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38d912121c64d5e887dc21e354b3cfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:09.914309 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c687fa78-c5f9-4989-93bc-8c7abbd1c3b9 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 200 len: 1554 microversion: 2.1 time: 0.155777 Jul 12 03:59:09.914855 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 505/971] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:59:09 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:59:10.151213 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-082a50c6-749d-4501-8f77-08481aeb22c3 req-a4146713-fbbb-4e77-9eac-7692f918f92e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc703cb-c9d3-4fce-a3af-2e7253cdb910", "name": "network-vif-deleted", "tag": "05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:59:10.162677 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-082a50c6-749d-4501-8f77-08481aeb22c3 req-a4146713-fbbb-4e77-9eac-7692f918f92e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:10.163128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-082a50c6-749d-4501-8f77-08481aeb22c3 req-a4146713-fbbb-4e77-9eac-7692f918f92e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:10.174603 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-082a50c6-749d-4501-8f77-08481aeb22c3 req-a4146713-fbbb-4e77-9eac-7692f918f92e service nova] Creating event network-vif-deleted:05ef6ad1-c8ac-4954-bf06-5e8c4aa06bf3 for instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 on hv-cinder-84773 Jul 12 03:59:10.179827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-082a50c6-749d-4501-8f77-08481aeb22c3 req-a4146713-fbbb-4e77-9eac-7692f918f92e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032812 Jul 12 03:59:10.180743 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 467/972] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:10.935805 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c89e04e1-c8b8-4147-945e-8375225e8294 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:10.936870 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c89e04e1-c8b8-4147-945e-8375225e8294 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] [instance: 7cc703cb-c9d3-4fce-a3af-2e7253cdb910] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:10.948222 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c89e04e1-c8b8-4147-945e-8375225e8294 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:10.948707 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c89e04e1-c8b8-4147-945e-8375225e8294 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:10.949484 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c89e04e1-c8b8-4147-945e-8375225e8294 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:10.949914 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c89e04e1-c8b8-4147-945e-8375225e8294 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:10.964356 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-c89e04e1-c8b8-4147-945e-8375225e8294 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] HTTP exception thrown: Instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 could not be found. Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c89e04e1-c8b8-4147-945e-8375225e8294 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Request method failure captured: Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 HTTP/1.1 Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizPCZDnvJKsnStMf5wMBzymF-JxIDIWn4KGLsi-KdBsWiqY_bk4Yfgylut5DBPfrvncjnKZ1Grf3Y3necHFnZhUglqt4H-bZ2aKUe2h-ivkJJTdgmt5pGyH8uGrU74CoPZU8FP_7JJKPmOlgTKVpSY2PLOgiX5WLFG4CDH1jQz4DXy4c Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: b38d912121c64d5e887dc21e354b3cfd Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-TestMinimumBasicScenario-44349850 Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 03:59:10.965864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 03:59:10.967438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b38d912121c64d5e887dc21e354b3cfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b38d912121c64d5e887dc21e354b3cfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b38d912121c64d5e887dc21e354b3cfd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b38d912121c64d5e887dc21e354b3cfd"}]}] Jul 12 03:59:10.967438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-TestMinimumBasicScenario-44349850 Jul 12 03:59:10.967438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: b38d912121c64d5e887dc21e354b3cfd Jul 12 03:59:10.967438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-TestMinimumBasicScenario-44349850 Jul 12 03:59:10.967438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-TestMinimumBasicScenario-44349850-project Jul 12 03:59:10.967438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 03:59:10.967438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 03:59:10.967438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 8701284390d345eabc027e05f9ac262b Jul 12 03:59:10.967438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-TestMinimumBasicScenario-44349850-project Jul 12 03:59:10.967438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 03:59:10.967438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 could not be found. Jul 12 03:59:10.967438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': '7cc703cb-c9d3-4fce-a3af-2e7253cdb910'} Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 could not be found. Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 03:59:10.968422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 could not be found. Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 could not be found. Jul 12 03:59:10.969875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 03:59:10.971375 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c89e04e1-c8b8-4147-945e-8375225e8294 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Returning 404 to user: Instance 7cc703cb-c9d3-4fce-a3af-2e7253cdb910 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 03:59:10.971375 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c89e04e1-c8b8-4147-945e-8375225e8294 tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910" status: 404 len: 111 microversion: 2.1 time: 0.038104 Jul 12 03:59:10.971375 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 506/973] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:59:10 2022] GET /compute/v2.1/servers/7cc703cb-c9d3-4fce-a3af-2e7253cdb910 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 03:59:10.977451 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b6c8c7fa-5431-4c04-afe8-b83d6af1852f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] Calling method '.version_select at 0x7fd7fa55bd30>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:10.998196 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b6c8c7fa-5431-4c04-afe8-b83d6af1852f tempest-TestMinimumBasicScenario-44349850 tempest-TestMinimumBasicScenario-44349850-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-381408628" status: 202 len: 0 microversion: 2.1 time: 0.025695 Jul 12 03:59:10.998758 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 468/974] 10.222.0.20 () {58 vars in 1268 bytes} [Tue Jul 12 03:59:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-381408628 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 03:59:28.911493 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=15 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:59:28.912327 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:59:29.083881 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8023ed98-aadb-4154-ac4c-f24ef5a04bfc tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Action: 'create', calling method: .version_select at 0x7fd7fa439790>, body: {"keypair": {"name": "tempest-TestShelveInstance-2018960855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAkGta79kU4meHTBZBRJjW3SuagbK8gJYTYArqy9cKsSrpTFRAaES2WKp0nmUU5a+fjjJTF98Xx19ks8/EYVjOYtux6kdCf0JlKmdnQBLFyPMjkqDnImVlUSXWoW5RytQ=="}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:59:29.098088 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-8023ed98-aadb-4154-ac4c-f24ef5a04bfc tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Getting quotas for project aac1a71ff09f4ae38a5c3704fc43a950. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:59:29.102284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-8023ed98-aadb-4154-ac4c-f24ef5a04bfc tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Getting quotas for user 5991e17e8dfb4a59a4dd1a4da24ff90c and project aac1a71ff09f4ae38a5c3704fc43a950. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:59:29.127315 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8023ed98-aadb-4154-ac4c-f24ef5a04bfc tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.220783 Jul 12 03:59:29.128387 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 507/975] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 03:59:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:33.560085 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:59:33.560916 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:59:33.566049 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-83bd6d99-b081-45e3-b351-178009d5734b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:33.566643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-83bd6d99-b081-45e3-b351-178009d5734b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:33.576124 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-83bd6d99-b081-45e3-b351-178009d5734b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:33.576575 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-83bd6d99-b081-45e3-b351-178009d5734b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:33.577345 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-83bd6d99-b081-45e3-b351-178009d5734b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:33.577781 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-83bd6d99-b081-45e3-b351-178009d5734b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:33.603092 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-83bd6d99-b081-45e3-b351-178009d5734b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/ips" status: 200 len: 145 microversion: 2.1 time: 0.045012 Jul 12 03:59:33.608061 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 469/976] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 03:59:33 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:34.955319 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ea4214fb-984d-4e99-bb18-53166074d211 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24b8c13c-8b80-4c0e-8c19-160e56a28eee"}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:59:34.960072 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ea4214fb-984d-4e99-bb18-53166074d211 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:34.963698 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ea4214fb-984d-4e99-bb18-53166074d211 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:34.964177 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ea4214fb-984d-4e99-bb18-53166074d211 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:34.965018 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ea4214fb-984d-4e99-bb18-53166074d211 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:34.965448 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ea4214fb-984d-4e99-bb18-53166074d211 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:35.242507 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ea4214fb-984d-4e99-bb18-53166074d211 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "POST /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291605 Jul 12 03:59:35.243103 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 508/977] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 03:59:34 2022] POST /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:42.814905 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-13d4f234-66fa-4c15-a74b-47e804e14e98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:42.815804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-13d4f234-66fa-4c15-a74b-47e804e14e98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:42.822475 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-13d4f234-66fa-4c15-a74b-47e804e14e98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:42.823155 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-13d4f234-66fa-4c15-a74b-47e804e14e98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:42.823914 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-13d4f234-66fa-4c15-a74b-47e804e14e98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:42.824382 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-13d4f234-66fa-4c15-a74b-47e804e14e98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:42.857861 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-13d4f234-66fa-4c15-a74b-47e804e14e98 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046913 Jul 12 03:59:42.858433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 470/978] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 03:59:42 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:42.870673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=4 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:59:42.877555 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6b385983-85db-4d7c-93ff-078319c0f2d4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:42.878508 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-6b385983-85db-4d7c-93ff-078319c0f2d4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:42.887129 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6b385983-85db-4d7c-93ff-078319c0f2d4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:42.887585 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6b385983-85db-4d7c-93ff-078319c0f2d4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:42.888388 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6b385983-85db-4d7c-93ff-078319c0f2d4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:42.888829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6b385983-85db-4d7c-93ff-078319c0f2d4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:42.918846 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-6b385983-85db-4d7c-93ff-078319c0f2d4 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments/24b8c13c-8b80-4c0e-8c19-160e56a28eee" status: 200 len: 194 microversion: 2.1 time: 0.050789 Jul 12 03:59:42.919418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 509/979] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Jul 12 03:59:42 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments/24b8c13c-8b80-4c0e-8c19-160e56a28eee => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:45.326974 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-061ee27a-0a38-4a02-a154-e94e6cde4f28 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab4410e1-24d1-4036-b11a-15e2bec3d2a6"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:59:45.328061 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-061ee27a-0a38-4a02-a154-e94e6cde4f28 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:45.335252 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-061ee27a-0a38-4a02-a154-e94e6cde4f28 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:45.335701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-061ee27a-0a38-4a02-a154-e94e6cde4f28 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:45.336504 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-061ee27a-0a38-4a02-a154-e94e6cde4f28 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:45.336940 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-061ee27a-0a38-4a02-a154-e94e6cde4f28 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:45.729580 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-061ee27a-0a38-4a02-a154-e94e6cde4f28 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "POST /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406307 Jul 12 03:59:45.730276 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 471/980] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 03:59:45 2022] POST /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:54.329897 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c6cfe9ba-c035-49f8-83d4-fc3cd18ed3af tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:54.330818 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c6cfe9ba-c035-49f8-83d4-fc3cd18ed3af tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:54.333269 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:59:54.333987 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 03:59:54.340353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6cfe9ba-c035-49f8-83d4-fc3cd18ed3af tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:54.340840 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6cfe9ba-c035-49f8-83d4-fc3cd18ed3af tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:54.341613 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6cfe9ba-c035-49f8-83d4-fc3cd18ed3af tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:54.342045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c6cfe9ba-c035-49f8-83d4-fc3cd18ed3af tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:54.374215 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c6cfe9ba-c035-49f8-83d4-fc3cd18ed3af tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048235 Jul 12 03:59:54.374771 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 510/981] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 03:59:54 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:54.533717 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-464c81a8-0930-44f9-b45f-f02e5012ebb6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:54.534289 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-464c81a8-0930-44f9-b45f-f02e5012ebb6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:54.541904 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-464c81a8-0930-44f9-b45f-f02e5012ebb6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:54.542357 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-464c81a8-0930-44f9-b45f-f02e5012ebb6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:54.543125 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-464c81a8-0930-44f9-b45f-f02e5012ebb6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:54.543560 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-464c81a8-0930-44f9-b45f-f02e5012ebb6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:54.573032 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-464c81a8-0930-44f9-b45f-f02e5012ebb6 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments/24b8c13c-8b80-4c0e-8c19-160e56a28eee" status: 200 len: 194 microversion: 2.1 time: 0.045114 Jul 12 03:59:54.573619 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 472/982] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Jul 12 03:59:54 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments/24b8c13c-8b80-4c0e-8c19-160e56a28eee => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:54.583577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1f18af08-ea79-4a1c-9de7-28170ec60dfd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:54.584101 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1f18af08-ea79-4a1c-9de7-28170ec60dfd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:54.590636 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1f18af08-ea79-4a1c-9de7-28170ec60dfd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:54.591087 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1f18af08-ea79-4a1c-9de7-28170ec60dfd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:54.591904 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1f18af08-ea79-4a1c-9de7-28170ec60dfd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:54.592365 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1f18af08-ea79-4a1c-9de7-28170ec60dfd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:54.674997 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-1f18af08-ea79-4a1c-9de7-28170ec60dfd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lazy-loading 'services' on Instance uuid b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:59:54.747447 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1f18af08-ea79-4a1c-9de7-28170ec60dfd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments/24b8c13c-8b80-4c0e-8c19-160e56a28eee" status: 202 len: 0 microversion: 2.1 time: 0.167706 Jul 12 03:59:54.748114 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 511/983] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 03:59:54 2022] DELETE /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments/24b8c13c-8b80-4c0e-8c19-160e56a28eee => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:59:54.877321 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1933526635", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2018960855", "security_groups": [{"name": "tempest-secgroup-smoke-2139082514"}], "networks": [{"uuid": "23b1d494-c0d9-49ee-89d4-d49d1b596fa3"}], "block_device_mapping_v2": [{"uuid": "ea9350b8-7288-489e-a799-d4ed1f326e70", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:59:54.999516 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.network.neutron [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] validate_networks() for [('23b1d494-c0d9-49ee-89d4-d49d1b596fa3', None, None, None, None, None)] {{(pid=124435) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 03:59:55.395935 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Flavor limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 03:59:55.396389 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Image limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 03:59:55.396862 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Flavor pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 03:59:55.397258 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Image pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 03:59:55.397662 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 03:59:55.407782 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:55.408268 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:55.409071 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:55.409531 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:55.426337 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Getting quotas for project aac1a71ff09f4ae38a5c3704fc43a950. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 03:59:55.430557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Getting quotas for user 5991e17e8dfb4a59a4dd1a4da24ff90c and project aac1a71ff09f4ae38a5c3704fc43a950. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 03:59:55.489918 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Going to run 1 instances... {{(pid=124435) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 03:59:55.492033 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea9350b8-7288-489e-a799-d4ed1f326e70',volume_size=None,volume_type=None)] {{(pid=124435) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 03:59:55.623237 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c41a7f3d-8f4c-4376-8a7d-c5ad6f2f6919 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749876 Jul 12 03:59:55.628348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 473/984] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 03:59:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 03:59:55.634671 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2937939a-9659-48ae-a28e-431176339f23 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:55.635377 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2937939a-9659-48ae-a28e-431176339f23 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:55.692625 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-2937939a-9659-48ae-a28e-431176339f23 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:55.699640 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2937939a-9659-48ae-a28e-431176339f23 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1089 microversion: 2.1 time: 0.069361 Jul 12 03:59:55.708047 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 512/985] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:59:55 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:59:56.717560 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f8b73f26-9e42-4039-87d5-348332fd7152 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:56.718775 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f8b73f26-9e42-4039-87d5-348332fd7152 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:56.726615 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f8b73f26-9e42-4039-87d5-348332fd7152 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:56.727311 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f8b73f26-9e42-4039-87d5-348332fd7152 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:56.728430 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f8b73f26-9e42-4039-87d5-348332fd7152 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:56.729021 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f8b73f26-9e42-4039-87d5-348332fd7152 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:56.816097 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0d006bb3-befb-41cd-b39f-2604c76520d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:56.817120 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0d006bb3-befb-41cd-b39f-2604c76520d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:56.824815 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d006bb3-befb-41cd-b39f-2604c76520d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:56.825273 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d006bb3-befb-41cd-b39f-2604c76520d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:56.826055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d006bb3-befb-41cd-b39f-2604c76520d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:56.826487 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0d006bb3-befb-41cd-b39f-2604c76520d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:56.837262 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f8b73f26-9e42-4039-87d5-348332fd7152 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:56.851526 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f8b73f26-9e42-4039-87d5-348332fd7152 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1195 microversion: 2.1 time: 0.138290 Jul 12 03:59:56.862089 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 474/986] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:59:56 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1195 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:59:56.862416 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0d006bb3-befb-41cd-b39f-2604c76520d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050621 Jul 12 03:59:56.864403 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 513/987] 10.222.0.20 () {60 vars in 1342 bytes} [Tue Jul 12 03:59:56 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:59:56.923591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a9027ccb-5d26-4c7a-a2de-aa7b1e8e7379 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:56.924115 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a9027ccb-5d26-4c7a-a2de-aa7b1e8e7379 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:56.925703 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-fbe2d306-fbac-41a4-8daf-c41419839d80 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:56.926202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-fbe2d306-fbac-41a4-8daf-c41419839d80 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:56.930514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a9027ccb-5d26-4c7a-a2de-aa7b1e8e7379 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:56.931180 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a9027ccb-5d26-4c7a-a2de-aa7b1e8e7379 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:56.931955 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a9027ccb-5d26-4c7a-a2de-aa7b1e8e7379 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:56.932380 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fbe2d306-fbac-41a4-8daf-c41419839d80 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:56.932512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a9027ccb-5d26-4c7a-a2de-aa7b1e8e7379 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:56.932844 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fbe2d306-fbac-41a4-8daf-c41419839d80 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:56.933617 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fbe2d306-fbac-41a4-8daf-c41419839d80 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:56.934057 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fbe2d306-fbac-41a4-8daf-c41419839d80 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:56.972797 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a9027ccb-5d26-4c7a-a2de-aa7b1e8e7379 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 03:59:56.975098 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-fbe2d306-fbac-41a4-8daf-c41419839d80 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments/ab4410e1-24d1-4036-b11a-15e2bec3d2a6" status: 200 len: 194 microversion: 2.1 time: 0.051920 Jul 12 03:59:56.980597 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 514/988] 10.222.0.20 () {58 vars in 1412 bytes} [Tue Jul 12 03:59:56 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments/ab4410e1-24d1-4036-b11a-15e2bec3d2a6 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 03:59:56.989050 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2e27f570-2de2-47d9-b82d-00f5f1472e1c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:56.989548 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2e27f570-2de2-47d9-b82d-00f5f1472e1c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:56.997096 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2e27f570-2de2-47d9-b82d-00f5f1472e1c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:56.997550 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2e27f570-2de2-47d9-b82d-00f5f1472e1c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:56.998397 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2e27f570-2de2-47d9-b82d-00f5f1472e1c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:56.998833 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2e27f570-2de2-47d9-b82d-00f5f1472e1c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:57.061835 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a9027ccb-5d26-4c7a-a2de-aa7b1e8e7379 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 204 len: 0 microversion: 2.20 time: 0.141566 Jul 12 03:59:57.066236 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 475/989] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jul 12 03:59:56 2022] DELETE /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 03:59:57.073858 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-24b4bba2-67ff-4b52-bcd1-3a58d10c06d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:57.074579 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-24b4bba2-67ff-4b52-bcd1-3a58d10c06d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:57.082784 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-24b4bba2-67ff-4b52-bcd1-3a58d10c06d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:57.083062 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-24b4bba2-67ff-4b52-bcd1-3a58d10c06d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:57.083830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-24b4bba2-67ff-4b52-bcd1-3a58d10c06d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:57.084374 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-24b4bba2-67ff-4b52-bcd1-3a58d10c06d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:57.091852 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-2e27f570-2de2-47d9-b82d-00f5f1472e1c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lazy-loading 'services' on Instance uuid b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 03:59:57.168174 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2e27f570-2de2-47d9-b82d-00f5f1472e1c tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments/ab4410e1-24d1-4036-b11a-15e2bec3d2a6" status: 202 len: 0 microversion: 2.1 time: 0.182860 Jul 12 03:59:57.169051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 515/990] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 03:59:56 2022] DELETE /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments/ab4410e1-24d1-4036-b11a-15e2bec3d2a6 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 03:59:57.319279 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-24b4bba2-67ff-4b52-bcd1-3a58d10c06d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:57.328193 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-24b4bba2-67ff-4b52-bcd1-3a58d10c06d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:57.329858 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-24b4bba2-67ff-4b52-bcd1-3a58d10c06d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:57.331102 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-24b4bba2-67ff-4b52-bcd1-3a58d10c06d6 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.263250 Jul 12 03:59:57.331716 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 476/991] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:59:57 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 03:59:57.871223 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b4cda7cc-c007-48ee-a823-c5341d246150 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:57.871923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b4cda7cc-c007-48ee-a823-c5341d246150 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:57.878715 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b4cda7cc-c007-48ee-a823-c5341d246150 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:57.879167 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b4cda7cc-c007-48ee-a823-c5341d246150 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:57.879937 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b4cda7cc-c007-48ee-a823-c5341d246150 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:57.880411 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b4cda7cc-c007-48ee-a823-c5341d246150 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:58.018281 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b4cda7cc-c007-48ee-a823-c5341d246150 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:58.025975 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b4cda7cc-c007-48ee-a823-c5341d246150 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1273 microversion: 2.1 time: 0.159700 Jul 12 03:59:58.026538 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 516/992] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:59:57 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:59:58.353329 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0a43a144-9830-492a-bd69-e75c723260bd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:58.354894 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0a43a144-9830-492a-bd69-e75c723260bd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:58.364991 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0a43a144-9830-492a-bd69-e75c723260bd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:58.365936 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0a43a144-9830-492a-bd69-e75c723260bd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:58.367404 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0a43a144-9830-492a-bd69-e75c723260bd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:58.368561 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0a43a144-9830-492a-bd69-e75c723260bd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:58.584326 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0a43a144-9830-492a-bd69-e75c723260bd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:58.593248 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0a43a144-9830-492a-bd69-e75c723260bd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:58.594756 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0a43a144-9830-492a-bd69-e75c723260bd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:58.595953 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0a43a144-9830-492a-bd69-e75c723260bd tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.247616 Jul 12 03:59:58.596545 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 477/993] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:59:58 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 03:59:59.042852 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8edb0ee5-699d-41e1-a310-f2f6f79e8657 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:59.043476 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8edb0ee5-699d-41e1-a310-f2f6f79e8657 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:59.051587 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8edb0ee5-699d-41e1-a310-f2f6f79e8657 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:59.052072 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8edb0ee5-699d-41e1-a310-f2f6f79e8657 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:59.052982 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8edb0ee5-699d-41e1-a310-f2f6f79e8657 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:59.053293 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8edb0ee5-699d-41e1-a310-f2f6f79e8657 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:59.079773 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-90c859c6-e812-4cad-9496-4f4d7b33dc90 req-db9e6e58-0051-4528-b347-b29ec4067f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b74d356-e773-4d8b-85cf-b31c80c2aef3", "tag": "c31ca6c3-cf04-4828-a8bf-1c95239cd2d1"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 03:59:59.092122 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-90c859c6-e812-4cad-9496-4f4d7b33dc90 req-db9e6e58-0051-4528-b347-b29ec4067f72 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:59.092638 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-90c859c6-e812-4cad-9496-4f4d7b33dc90 req-db9e6e58-0051-4528-b347-b29ec4067f72 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:59.107187 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-90c859c6-e812-4cad-9496-4f4d7b33dc90 req-db9e6e58-0051-4528-b347-b29ec4067f72 service nova] Creating event network-changed:c31ca6c3-cf04-4828-a8bf-1c95239cd2d1 for instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3 on hv-cinder-84773 Jul 12 03:59:59.112177 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-90c859c6-e812-4cad-9496-4f4d7b33dc90 req-db9e6e58-0051-4528-b347-b29ec4067f72 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037074 Jul 12 03:59:59.112787 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 478/994] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 03:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 03:59:59.219883 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8edb0ee5-699d-41e1-a310-f2f6f79e8657 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:59.228075 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8edb0ee5-699d-41e1-a310-f2f6f79e8657 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.189134 Jul 12 03:59:59.228668 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 517/995] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 03:59:59 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 03:59:59.615377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a7ff19f1-ef13-4edf-9b9d-ddf14103dbfb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 03:59:59.616142 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a7ff19f1-ef13-4edf-9b9d-ddf14103dbfb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 03:59:59.629037 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a7ff19f1-ef13-4edf-9b9d-ddf14103dbfb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:59.629718 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a7ff19f1-ef13-4edf-9b9d-ddf14103dbfb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:59.630707 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a7ff19f1-ef13-4edf-9b9d-ddf14103dbfb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 03:59:59.631337 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a7ff19f1-ef13-4edf-9b9d-ddf14103dbfb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 03:59:59.953554 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a7ff19f1-ef13-4edf-9b9d-ddf14103dbfb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:59.962253 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a7ff19f1-ef13-4edf-9b9d-ddf14103dbfb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:59.963720 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a7ff19f1-ef13-4edf-9b9d-ddf14103dbfb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 03:59:59.965146 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a7ff19f1-ef13-4edf-9b9d-ddf14103dbfb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1724 microversion: 2.20 time: 0.354545 Jul 12 03:59:59.965852 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 479/996] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 03:59:59 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 04:00:00.245875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d7e1730e-a697-466f-a125-bc863479ed3a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:00.246554 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d7e1730e-a697-466f-a125-bc863479ed3a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:00.253812 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d7e1730e-a697-466f-a125-bc863479ed3a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:00.254392 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d7e1730e-a697-466f-a125-bc863479ed3a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:00.255234 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d7e1730e-a697-466f-a125-bc863479ed3a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:00.255660 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d7e1730e-a697-466f-a125-bc863479ed3a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:00.396931 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d7e1730e-a697-466f-a125-bc863479ed3a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:00.405291 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d7e1730e-a697-466f-a125-bc863479ed3a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.163194 Jul 12 04:00:00.406201 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 518/997] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:00 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:00.462777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1b79d565-59b8-4c26-ba97-89c706b7d435 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:00.463963 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1b79d565-59b8-4c26-ba97-89c706b7d435 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:00.470335 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1b79d565-59b8-4c26-ba97-89c706b7d435 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:00.470779 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1b79d565-59b8-4c26-ba97-89c706b7d435 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:00.471535 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1b79d565-59b8-4c26-ba97-89c706b7d435 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:00.471960 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1b79d565-59b8-4c26-ba97-89c706b7d435 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:00.502593 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1b79d565-59b8-4c26-ba97-89c706b7d435 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043752 Jul 12 04:00:00.503138 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 480/998] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 04:00:00 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 04:00:00.615388 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-635ba772-11e8-42f8-8349-f7600ea7d478 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:00.616293 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-635ba772-11e8-42f8-8349-f7600ea7d478 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:00.622663 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-635ba772-11e8-42f8-8349-f7600ea7d478 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:00.623108 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-635ba772-11e8-42f8-8349-f7600ea7d478 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:00.623997 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-635ba772-11e8-42f8-8349-f7600ea7d478 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:00.624459 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-635ba772-11e8-42f8-8349-f7600ea7d478 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:00.653319 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-635ba772-11e8-42f8-8349-f7600ea7d478 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041922 Jul 12 04:00:00.653921 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 519/999] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 04:00:00 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 04:00:00.721695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-25d66601-109c-4e75-8123-58fbdedfd000 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:00.722280 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-25d66601-109c-4e75-8123-58fbdedfd000 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:00.731275 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25d66601-109c-4e75-8123-58fbdedfd000 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:00.731830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25d66601-109c-4e75-8123-58fbdedfd000 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:00.732830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25d66601-109c-4e75-8123-58fbdedfd000 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:00.733338 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-25d66601-109c-4e75-8123-58fbdedfd000 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:00.761303 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-25d66601-109c-4e75-8123-58fbdedfd000 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 04:00:00.845775 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-25d66601-109c-4e75-8123-58fbdedfd000 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 204 len: 0 microversion: 2.1 time: 0.127923 Jul 12 04:00:00.848348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 481/1000] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:00:00 2022] DELETE /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 04:00:00.854764 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1935fffe-e831-4ee2-b176-46dbf23abfec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:00.855373 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1935fffe-e831-4ee2-b176-46dbf23abfec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:00.862123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1935fffe-e831-4ee2-b176-46dbf23abfec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:00.862568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1935fffe-e831-4ee2-b176-46dbf23abfec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:00.863343 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1935fffe-e831-4ee2-b176-46dbf23abfec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:00.863762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1935fffe-e831-4ee2-b176-46dbf23abfec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:00.984053 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d74568d0-ab86-4dbb-adbf-e91b0dc52a3d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:00.985188 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d74568d0-ab86-4dbb-adbf-e91b0dc52a3d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:00.991910 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d74568d0-ab86-4dbb-adbf-e91b0dc52a3d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:00.992669 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d74568d0-ab86-4dbb-adbf-e91b0dc52a3d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:00.994284 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d74568d0-ab86-4dbb-adbf-e91b0dc52a3d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:00.994873 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d74568d0-ab86-4dbb-adbf-e91b0dc52a3d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:01.020595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:01.025067 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1935fffe-e831-4ee2-b176-46dbf23abfec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:01.034272 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1935fffe-e831-4ee2-b176-46dbf23abfec tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1673 microversion: 2.1 time: 0.183270 Jul 12 04:00:01.035725 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 520/1001] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:00 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:01.067341 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d74568d0-ab86-4dbb-adbf-e91b0dc52a3d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:01.076120 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d74568d0-ab86-4dbb-adbf-e91b0dc52a3d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:01.077813 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d74568d0-ab86-4dbb-adbf-e91b0dc52a3d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:01.079096 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d74568d0-ab86-4dbb-adbf-e91b0dc52a3d tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1656 microversion: 2.20 time: 0.100051 Jul 12 04:00:01.079808 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 482/1002] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 04:00:00 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 04:00:01.128633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-6f66c9d3-21b8-4332-87c2-6fa03f1f4e1a req-5b01ceb6-81eb-46dc-8856-03161af12f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63", "name": "network-vif-deleted", "tag": "17836774-6562-4ed2-9a30-cc38e71017de"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:00:01.136964 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-6f66c9d3-21b8-4332-87c2-6fa03f1f4e1a req-5b01ceb6-81eb-46dc-8856-03161af12f6f service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:01.137520 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-6f66c9d3-21b8-4332-87c2-6fa03f1f4e1a req-5b01ceb6-81eb-46dc-8856-03161af12f6f service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:01.149387 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-6f66c9d3-21b8-4332-87c2-6fa03f1f4e1a req-5b01ceb6-81eb-46dc-8856-03161af12f6f service nova] Creating event network-vif-deleted:17836774-6562-4ed2-9a30-cc38e71017de for instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 on hv-cinder-84773 Jul 12 04:00:01.154485 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-6f66c9d3-21b8-4332-87c2-6fa03f1f4e1a req-5b01ceb6-81eb-46dc-8856-03161af12f6f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029692 Jul 12 04:00:01.155389 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 521/1003] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:00:01.423142 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-30031d45-7981-4b59-9856-e48322b274af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:01.423650 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-30031d45-7981-4b59-9856-e48322b274af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:01.430604 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30031d45-7981-4b59-9856-e48322b274af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:01.431055 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30031d45-7981-4b59-9856-e48322b274af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:01.431832 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30031d45-7981-4b59-9856-e48322b274af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:01.432310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-30031d45-7981-4b59-9856-e48322b274af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:01.567356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-30031d45-7981-4b59-9856-e48322b274af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:01.574884 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-30031d45-7981-4b59-9856-e48322b274af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.155882 Jul 12 04:00:01.575449 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 483/1004] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:01 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:02.057621 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f1f0050e-7574-4897-a1af-9720bb14a2fd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:02.058693 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f1f0050e-7574-4897-a1af-9720bb14a2fd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:02.066856 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1f0050e-7574-4897-a1af-9720bb14a2fd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:02.067311 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1f0050e-7574-4897-a1af-9720bb14a2fd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:02.068113 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1f0050e-7574-4897-a1af-9720bb14a2fd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:02.068570 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1f0050e-7574-4897-a1af-9720bb14a2fd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:02.097777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b656ab54-b4e8-4cb4-9163-9d12430ef5d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:02.098360 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b656ab54-b4e8-4cb4-9163-9d12430ef5d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:02.105400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b656ab54-b4e8-4cb4-9163-9d12430ef5d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:02.105845 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b656ab54-b4e8-4cb4-9163-9d12430ef5d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:02.106619 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b656ab54-b4e8-4cb4-9163-9d12430ef5d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:02.107050 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b656ab54-b4e8-4cb4-9163-9d12430ef5d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:02.172643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b656ab54-b4e8-4cb4-9163-9d12430ef5d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:02.181163 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b656ab54-b4e8-4cb4-9163-9d12430ef5d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:02.182673 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b656ab54-b4e8-4cb4-9163-9d12430ef5d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:02.183814 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b656ab54-b4e8-4cb4-9163-9d12430ef5d1 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1366 microversion: 2.20 time: 0.090033 Jul 12 04:00:02.184440 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 484/1005] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 04:00:02 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 04:00:02.199754 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f1f0050e-7574-4897-a1af-9720bb14a2fd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:02.207267 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f1f0050e-7574-4897-a1af-9720bb14a2fd tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1673 microversion: 2.1 time: 0.157450 Jul 12 04:00:02.207872 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 522/1006] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:02 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:02.593401 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7525b4ad-3922-4c52-bdf1-e45577ba0510 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:02.594297 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7525b4ad-3922-4c52-bdf1-e45577ba0510 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:02.602359 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7525b4ad-3922-4c52-bdf1-e45577ba0510 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:02.603051 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7525b4ad-3922-4c52-bdf1-e45577ba0510 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:02.604333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7525b4ad-3922-4c52-bdf1-e45577ba0510 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:02.605008 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7525b4ad-3922-4c52-bdf1-e45577ba0510 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:02.738333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-7525b4ad-3922-4c52-bdf1-e45577ba0510 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:02.746450 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7525b4ad-3922-4c52-bdf1-e45577ba0510 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.157616 Jul 12 04:00:02.747032 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 485/1007] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:02 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:03.202176 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:03.202779 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:03.209402 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:03.209848 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:03.210614 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:03.211040 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:03.226459 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ae75a0fd-fec2-4cf9-aee8-b4ca8f56382b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:03.227956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ae75a0fd-fec2-4cf9-aee8-b4ca8f56382b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:03.235176 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae75a0fd-fec2-4cf9-aee8-b4ca8f56382b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:03.235687 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae75a0fd-fec2-4cf9-aee8-b4ca8f56382b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:03.236983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae75a0fd-fec2-4cf9-aee8-b4ca8f56382b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:03.237493 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae75a0fd-fec2-4cf9-aee8-b4ca8f56382b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:03.245227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:03.245673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:03.246125 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lazy-loading 'fault' on Instance uuid bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 04:00:03.292128 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:03.300564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:03.302173 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf67549bf7e443c6b77eaf71fb6b709c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9417b8011914e108ae00b5aa583ce50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:03.303567 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-da7bbf16-734a-4380-b68d-39f83d911efa tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 200 len: 1371 microversion: 2.20 time: 0.105461 Jul 12 04:00:03.304440 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 523/1008] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 04:00:03 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 04:00:03.367504 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ae75a0fd-fec2-4cf9-aee8-b4ca8f56382b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:03.375506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ae75a0fd-fec2-4cf9-aee8-b4ca8f56382b tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1673 microversion: 2.1 time: 0.154875 Jul 12 04:00:03.376114 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 486/1009] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:03 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:03.762920 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-28f6c4b2-3e78-48c5-b42d-c9c6fd0ce275 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:03.763680 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-28f6c4b2-3e78-48c5-b42d-c9c6fd0ce275 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:03.770063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-28f6c4b2-3e78-48c5-b42d-c9c6fd0ce275 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:03.770505 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-28f6c4b2-3e78-48c5-b42d-c9c6fd0ce275 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:03.771260 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-28f6c4b2-3e78-48c5-b42d-c9c6fd0ce275 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:03.771689 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-28f6c4b2-3e78-48c5-b42d-c9c6fd0ce275 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:03.912032 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-28f6c4b2-3e78-48c5-b42d-c9c6fd0ce275 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:03.920298 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-28f6c4b2-3e78-48c5-b42d-c9c6fd0ce275 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.161184 Jul 12 04:00:03.921238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 524/1010] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:03 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:04.322145 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8d3413a1-1c68-4279-a6f4-a4e2d1f9ee4f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:04.322826 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8d3413a1-1c68-4279-a6f4-a4e2d1f9ee4f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:04.325150 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:04.330900 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d3413a1-1c68-4279-a6f4-a4e2d1f9ee4f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:04.331340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d3413a1-1c68-4279-a6f4-a4e2d1f9ee4f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:04.332141 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d3413a1-1c68-4279-a6f4-a4e2d1f9ee4f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:04.332574 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d3413a1-1c68-4279-a6f4-a4e2d1f9ee4f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:04.348028 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-8d3413a1-1c68-4279-a6f4-a4e2d1f9ee4f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] HTTP exception thrown: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8d3413a1-1c68-4279-a6f4-a4e2d1f9ee4f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Request method failure captured: Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 HTTP/1.1 Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO88sMKBC-68lnxLFtEdk9rhON0yYCN-r7zPJSNYf8_kMKEMAYORFEp5ctyZtoFZmyHbvfrJjALpYcPvL9qi0rSpqkJk9axiu64shKgTjIuPSEPVK4wYPKJgBzthkzIcaErfaB63QYc7wm5jVNPYFB0YNH6siHhLjxUiaNZ94K4fycY Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: e9417b8011914e108ae00b5aa583ce50 Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:00:04.349712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:00:04.351400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9417b8011914e108ae00b5aa583ce50"}]}] Jul 12 04:00:04.351400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:04.351400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: e9417b8011914e108ae00b5aa583ce50 Jul 12 04:00:04.351400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:04.351400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeShelveTestJSON-375334058-project Jul 12 04:00:04.351400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:00:04.351400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:00:04.351400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: bf67549bf7e443c6b77eaf71fb6b709c Jul 12 04:00:04.351400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeShelveTestJSON-375334058-project Jul 12 04:00:04.351400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:00:04.351400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:04.351400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63'} Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:00:04.352676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:04.354027 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:04.355512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8d3413a1-1c68-4279-a6f4-a4e2d1f9ee4f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Returning 404 to user: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:00:04.355512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8d3413a1-1c68-4279-a6f4-a4e2d1f9ee4f tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 404 len: 111 microversion: 2.20 time: 0.033179 Jul 12 04:00:04.355512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 487/1011] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 04:00:04 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 04:00:04.361047 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ece66abd-f336-49ac-aa12-13033dc69eae tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '.version_select at 0x7fd7fa439550>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:04.381086 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ece66abd-f336-49ac-aa12-13033dc69eae tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-995521979" status: 204 len: 0 microversion: 2.20 time: 0.024072 Jul 12 04:00:04.381880 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 525/1012] 10.222.0.20 () {60 vars in 1258 bytes} [Tue Jul 12 04:00:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-995521979 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 04:00:04.392689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2247f58f-c58d-47a7-9949-cd97d946022d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:04.394031 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-2247f58f-c58d-47a7-9949-cd97d946022d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:04.401116 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2247f58f-c58d-47a7-9949-cd97d946022d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:04.402155 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2247f58f-c58d-47a7-9949-cd97d946022d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:04.402957 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2247f58f-c58d-47a7-9949-cd97d946022d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:04.403397 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2247f58f-c58d-47a7-9949-cd97d946022d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:04.490757 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-2247f58f-c58d-47a7-9949-cd97d946022d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10d2c10313c4be2a8c11cff1eed8852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ceaecc3b7fc4fed9dce1e3ab1014ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:04.498443 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-2247f58f-c58d-47a7-9949-cd97d946022d tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 200 len: 1605 microversion: 2.1 time: 0.109896 Jul 12 04:00:04.499026 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 488/1013] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:04 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 1605 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:04.726921 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-fe70b72e-c9f4-4dc3-9882-970e73fe7b29 req-5914561f-5db9-44a8-9fd2-80763743d749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0", "name": "network-vif-deleted", "tag": "b4d13628-bffc-4297-8cf1-0d24b7c4bea0"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:00:04.735401 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-fe70b72e-c9f4-4dc3-9882-970e73fe7b29 req-5914561f-5db9-44a8-9fd2-80763743d749 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:04.735857 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-fe70b72e-c9f4-4dc3-9882-970e73fe7b29 req-5914561f-5db9-44a8-9fd2-80763743d749 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:04.748231 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-fe70b72e-c9f4-4dc3-9882-970e73fe7b29 req-5914561f-5db9-44a8-9fd2-80763743d749 service nova] Creating event network-vif-deleted:b4d13628-bffc-4297-8cf1-0d24b7c4bea0 for instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 on hv-cinder-84773 Jul 12 04:00:04.754570 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-fe70b72e-c9f4-4dc3-9882-970e73fe7b29 req-5914561f-5db9-44a8-9fd2-80763743d749 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031254 Jul 12 04:00:04.759002 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 526/1014] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:00:04.938084 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-03479cfb-0e15-4819-80b1-ea5427cf48b4 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:04.939090 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-03479cfb-0e15-4819-80b1-ea5427cf48b4 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:04.951085 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-03479cfb-0e15-4819-80b1-ea5427cf48b4 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:04.952175 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-03479cfb-0e15-4819-80b1-ea5427cf48b4 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:04.953537 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-03479cfb-0e15-4819-80b1-ea5427cf48b4 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:04.954317 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-03479cfb-0e15-4819-80b1-ea5427cf48b4 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:05.119537 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-03479cfb-0e15-4819-80b1-ea5427cf48b4 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:05.127565 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-03479cfb-0e15-4819-80b1-ea5427cf48b4 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.193424 Jul 12 04:00:05.128162 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 489/1015] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:04 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:05.516808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-108e60d6-7a30-401e-8f53-b709031845c7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:05.517606 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-108e60d6-7a30-401e-8f53-b709031845c7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:05.525586 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-108e60d6-7a30-401e-8f53-b709031845c7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:05.526132 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-108e60d6-7a30-401e-8f53-b709031845c7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:05.527071 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-108e60d6-7a30-401e-8f53-b709031845c7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:05.527589 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-108e60d6-7a30-401e-8f53-b709031845c7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:05.542149 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-108e60d6-7a30-401e-8f53-b709031845c7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] HTTP exception thrown: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-108e60d6-7a30-401e-8f53-b709031845c7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Request method failure captured: Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 HTTP/1.1 Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO-gJ7kDGy6dVaiKGKo8CX9Ky2cDF0Skq1U_TQB9CcUv8z7tzu1s0RTqU-uMNuF4XsBgVq3WyidHTf0iVrtVovi2yQUdZtSdhk-dNXYfiWX2z8gsRZ33xIMHvNT-8h92q_7OKsQuLKDgiAX9DVoVGuBKSbowlvoAv8Nlqo_L61yCpsg Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 2ceaecc3b7fc4fed9dce1e3ab1014ed2 Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:00:05.543816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:00:05.545422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}] Jul 12 04:00:05.545422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:05.545422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 2ceaecc3b7fc4fed9dce1e3ab1014ed2 Jul 12 04:00:05.545422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:05.545422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-AttachVolumeTestJSON-21093929-project Jul 12 04:00:05.545422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:00:05.545422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:00:05.545422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: b10d2c10313c4be2a8c11cff1eed8852 Jul 12 04:00:05.545422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-AttachVolumeTestJSON-21093929-project Jul 12 04:00:05.545422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:00:05.545422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:05.545422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0'} Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:00:05.546418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:05.547879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:05.549492 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-108e60d6-7a30-401e-8f53-b709031845c7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Returning 404 to user: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:00:05.549492 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-108e60d6-7a30-401e-8f53-b709031845c7 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 404 len: 111 microversion: 2.1 time: 0.034191 Jul 12 04:00:05.549492 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 527/1016] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:05 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:00:05.554762 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-144fbe7d-0c20-4cd2-ac5c-83c3842f24ca tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '.version_select at 0x7fd7fa5bbdc0>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:05.561994 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:05.562806 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=6 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:05.580198 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-144fbe7d-0c20-4cd2-ac5c-83c3842f24ca tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-659661136" status: 202 len: 0 microversion: 2.1 time: 0.029212 Jul 12 04:00:05.580786 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 490/1017] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jul 12 04:00:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-659661136 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 04:00:06.145188 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-73299320-53ba-421b-8748-4c5fd6ea0e76 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:06.145783 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-73299320-53ba-421b-8748-4c5fd6ea0e76 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:06.147763 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:06.153409 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-73299320-53ba-421b-8748-4c5fd6ea0e76 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:06.153850 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-73299320-53ba-421b-8748-4c5fd6ea0e76 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:06.154644 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-73299320-53ba-421b-8748-4c5fd6ea0e76 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:06.155076 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-73299320-53ba-421b-8748-4c5fd6ea0e76 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:06.243118 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ed90a1cb-6850-4916-a749-0b28a1accefb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:06.243622 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ed90a1cb-6850-4916-a749-0b28a1accefb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:06.250884 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ed90a1cb-6850-4916-a749-0b28a1accefb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:06.251309 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ed90a1cb-6850-4916-a749-0b28a1accefb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:06.252117 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ed90a1cb-6850-4916-a749-0b28a1accefb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:06.252573 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ed90a1cb-6850-4916-a749-0b28a1accefb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:06.268038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-ed90a1cb-6850-4916-a749-0b28a1accefb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] HTTP exception thrown: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ed90a1cb-6850-4916-a749-0b28a1accefb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Request method failure captured: Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: DELETE /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 HTTP/1.1 Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO88sMKBC-68lnxLFtEdk9rhON0yYCN-r7zPJSNYf8_kMKEMAYORFEp5ctyZtoFZmyHbvfrJjALpYcPvL9qi0rSpqkJk9axiu64shKgTjIuPSEPVK4wYPKJgBzthkzIcaErfaB63QYc7wm5jVNPYFB0YNH6siHhLjxUiaNZ94K4fycY Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: e9417b8011914e108ae00b5aa583ce50 Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:00:06.269733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:00:06.271608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9417b8011914e108ae00b5aa583ce50"}]}] Jul 12 04:00:06.271608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:06.271608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: e9417b8011914e108ae00b5aa583ce50 Jul 12 04:00:06.271608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:06.271608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeShelveTestJSON-375334058-project Jul 12 04:00:06.271608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:00:06.271608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:00:06.271608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: bf67549bf7e443c6b77eaf71fb6b709c Jul 12 04:00:06.271608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeShelveTestJSON-375334058-project Jul 12 04:00:06.271608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:00:06.271608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:06.271608 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63'} Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:00:06.276015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:06.278034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:06.279813 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ed90a1cb-6850-4916-a749-0b28a1accefb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Returning 404 to user: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:00:06.279813 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ed90a1cb-6850-4916-a749-0b28a1accefb tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 404 len: 111 microversion: 2.20 time: 0.032068 Jul 12 04:00:06.279813 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 491/1018] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jul 12 04:00:06 2022] DELETE /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 04:00:06.289893 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e0d01fed-c4e5-4bd6-8819-4c2383f46752 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:06.290506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e0d01fed-c4e5-4bd6-8819-4c2383f46752 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:06.297254 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e0d01fed-c4e5-4bd6-8819-4c2383f46752 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:06.297867 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e0d01fed-c4e5-4bd6-8819-4c2383f46752 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:06.298726 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e0d01fed-c4e5-4bd6-8819-4c2383f46752 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:06.299283 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e0d01fed-c4e5-4bd6-8819-4c2383f46752 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:06.309101 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-73299320-53ba-421b-8748-4c5fd6ea0e76 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:06.314432 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-e0d01fed-c4e5-4bd6-8819-4c2383f46752 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] HTTP exception thrown: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:06.314915 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e0d01fed-c4e5-4bd6-8819-4c2383f46752 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Request method failure captured: Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 HTTP/1.1 Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO88sMKBC-68lnxLFtEdk9rhON0yYCN-r7zPJSNYf8_kMKEMAYORFEp5ctyZtoFZmyHbvfrJjALpYcPvL9qi0rSpqkJk9axiu64shKgTjIuPSEPVK4wYPKJgBzthkzIcaErfaB63QYc7wm5jVNPYFB0YNH6siHhLjxUiaNZ94K4fycY Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: e9417b8011914e108ae00b5aa583ce50 Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:00:06.316206 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:00:06.318215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9417b8011914e108ae00b5aa583ce50"}]}] Jul 12 04:00:06.318215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:06.318215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: e9417b8011914e108ae00b5aa583ce50 Jul 12 04:00:06.318215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:06.318215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeShelveTestJSON-375334058-project Jul 12 04:00:06.318215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:00:06.318215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:00:06.318215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: bf67549bf7e443c6b77eaf71fb6b709c Jul 12 04:00:06.318215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeShelveTestJSON-375334058-project Jul 12 04:00:06.318215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:00:06.318215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:06.318215 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63'} Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:00:06.319199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. Jul 12 04:00:06.320776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:06.322337 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e0d01fed-c4e5-4bd6-8819-4c2383f46752 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Returning 404 to user: Instance bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:00:06.322481 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-73299320-53ba-421b-8748-4c5fd6ea0e76 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.178569 Jul 12 04:00:06.322591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e0d01fed-c4e5-4bd6-8819-4c2383f46752 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63" status: 404 len: 111 microversion: 2.20 time: 0.044210 Jul 12 04:00:06.323322 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 492/1019] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 04:00:06 2022] GET /compute/v2.1/servers/bd6fd864-32fc-4bb0-97b7-e3f1e6d64f63 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 04:00:06.327548 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 528/1020] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:06 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:07.340675 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ed98eff1-7bc1-4137-bde3-cb0ab651d194 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:07.341794 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ed98eff1-7bc1-4137-bde3-cb0ab651d194 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:07.349512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ed98eff1-7bc1-4137-bde3-cb0ab651d194 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:07.349994 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ed98eff1-7bc1-4137-bde3-cb0ab651d194 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:07.350801 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ed98eff1-7bc1-4137-bde3-cb0ab651d194 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:07.351244 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ed98eff1-7bc1-4137-bde3-cb0ab651d194 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:07.467303 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-dc338fa5-b6a1-4df1-9ac6-428e51e8ffae tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:07.467830 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-dc338fa5-b6a1-4df1-9ac6-428e51e8ffae tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:07.476296 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dc338fa5-b6a1-4df1-9ac6-428e51e8ffae tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:07.476753 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dc338fa5-b6a1-4df1-9ac6-428e51e8ffae tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:07.477545 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dc338fa5-b6a1-4df1-9ac6-428e51e8ffae tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:07.477985 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dc338fa5-b6a1-4df1-9ac6-428e51e8ffae tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:07.492447 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-dc338fa5-b6a1-4df1-9ac6-428e51e8ffae tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] HTTP exception thrown: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-dc338fa5-b6a1-4df1-9ac6-428e51e8ffae tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Request method failure captured: Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: DELETE /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a HTTP/1.1 Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO88sMKBC-68lnxLFtEdk9rhON0yYCN-r7zPJSNYf8_kMKEMAYORFEp5ctyZtoFZmyHbvfrJjALpYcPvL9qi0rSpqkJk9axiu64shKgTjIuPSEPVK4wYPKJgBzthkzIcaErfaB63QYc7wm5jVNPYFB0YNH6siHhLjxUiaNZ94K4fycY Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: e9417b8011914e108ae00b5aa583ce50 Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:00:07.494064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:00:07.495578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9417b8011914e108ae00b5aa583ce50"}]}] Jul 12 04:00:07.495578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:07.495578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: e9417b8011914e108ae00b5aa583ce50 Jul 12 04:00:07.495578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:07.495578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-AttachVolumeShelveTestJSON-375334058-project Jul 12 04:00:07.495578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:00:07.495578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:00:07.495578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: bf67549bf7e443c6b77eaf71fb6b709c Jul 12 04:00:07.495578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-AttachVolumeShelveTestJSON-375334058-project Jul 12 04:00:07.495578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:00:07.495578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 04:00:07.495578 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'ae771f5b-03de-46db-82fc-cd94d731405a'} Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:00:07.496534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 04:00:07.497774 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:07.499017 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-dc338fa5-b6a1-4df1-9ac6-428e51e8ffae tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Returning 404 to user: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:00:07.499017 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-dc338fa5-b6a1-4df1-9ac6-428e51e8ffae tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 404 len: 111 microversion: 2.20 time: 0.032244 Jul 12 04:00:07.499017 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 529/1021] 10.222.0.20 () {60 vars in 1279 bytes} [Tue Jul 12 04:00:07 2022] DELETE /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 04:00:07.499452 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ed98eff1-7bc1-4137-bde3-cb0ab651d194 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:07.503842 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-65457aa3-07d5-4094-9aff-56cbe9ce1cb0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:07.504494 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-65457aa3-07d5-4094-9aff-56cbe9ce1cb0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] [instance: ae771f5b-03de-46db-82fc-cd94d731405a] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:07.505351 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ed98eff1-7bc1-4137-bde3-cb0ab651d194 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.171340 Jul 12 04:00:07.506169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 493/1022] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:07 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:07.510715 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-65457aa3-07d5-4094-9aff-56cbe9ce1cb0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:07.511162 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-65457aa3-07d5-4094-9aff-56cbe9ce1cb0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:07.511928 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-65457aa3-07d5-4094-9aff-56cbe9ce1cb0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:07.512393 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-65457aa3-07d5-4094-9aff-56cbe9ce1cb0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:07.525757 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-65457aa3-07d5-4094-9aff-56cbe9ce1cb0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] HTTP exception thrown: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-65457aa3-07d5-4094-9aff-56cbe9ce1cb0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Request method failure captured: Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a HTTP/1.1 Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO88sMKBC-68lnxLFtEdk9rhON0yYCN-r7zPJSNYf8_kMKEMAYORFEp5ctyZtoFZmyHbvfrJjALpYcPvL9qi0rSpqkJk9axiu64shKgTjIuPSEPVK4wYPKJgBzthkzIcaErfaB63QYc7wm5jVNPYFB0YNH6siHhLjxUiaNZ94K4fycY Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: e9417b8011914e108ae00b5aa583ce50 Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:00:07.527326 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:00:07.529038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9417b8011914e108ae00b5aa583ce50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9417b8011914e108ae00b5aa583ce50"}]}] Jul 12 04:00:07.529038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:07.529038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: e9417b8011914e108ae00b5aa583ce50 Jul 12 04:00:07.529038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-375334058 Jul 12 04:00:07.529038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-AttachVolumeShelveTestJSON-375334058-project Jul 12 04:00:07.529038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:00:07.529038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:00:07.529038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: bf67549bf7e443c6b77eaf71fb6b709c Jul 12 04:00:07.529038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-AttachVolumeShelveTestJSON-375334058-project Jul 12 04:00:07.529038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:00:07.529038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 04:00:07.529038 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'ae771f5b-03de-46db-82fc-cd94d731405a'} Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:00:07.529866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. Jul 12 04:00:07.531551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:07.532722 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-65457aa3-07d5-4094-9aff-56cbe9ce1cb0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] Returning 404 to user: Instance ae771f5b-03de-46db-82fc-cd94d731405a could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:00:07.532722 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-65457aa3-07d5-4094-9aff-56cbe9ce1cb0 tempest-AttachVolumeShelveTestJSON-375334058 tempest-AttachVolumeShelveTestJSON-375334058-project] 10.222.0.20 "GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a" status: 404 len: 111 microversion: 2.20 time: 0.028549 Jul 12 04:00:07.532722 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 530/1023] 10.222.0.20 () {60 vars in 1276 bytes} [Tue Jul 12 04:00:07 2022] GET /compute/v2.1/servers/ae771f5b-03de-46db-82fc-cd94d731405a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 12 04:00:08.512936 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fcc8e7ec-a36c-42fc-92e3-38e2a3197a53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:08.514071 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-fcc8e7ec-a36c-42fc-92e3-38e2a3197a53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:08.521603 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fcc8e7ec-a36c-42fc-92e3-38e2a3197a53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:08.522309 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c9dcdbc1-45ea-47f2-81ac-0489c8064377 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:08.522749 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fcc8e7ec-a36c-42fc-92e3-38e2a3197a53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:08.523177 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c9dcdbc1-45ea-47f2-81ac-0489c8064377 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:08.523381 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fcc8e7ec-a36c-42fc-92e3-38e2a3197a53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:08.523825 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fcc8e7ec-a36c-42fc-92e3-38e2a3197a53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:08.530577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c9dcdbc1-45ea-47f2-81ac-0489c8064377 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:08.535804 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c9dcdbc1-45ea-47f2-81ac-0489c8064377 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:08.536987 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c9dcdbc1-45ea-47f2-81ac-0489c8064377 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:08.537658 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c9dcdbc1-45ea-47f2-81ac-0489c8064377 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:08.539689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-fcc8e7ec-a36c-42fc-92e3-38e2a3197a53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] HTTP exception thrown: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fcc8e7ec-a36c-42fc-92e3-38e2a3197a53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Request method failure captured: Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: DELETE /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 HTTP/1.1 Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO-gJ7kDGy6dVaiKGKo8CX9Ky2cDF0Skq1U_TQB9CcUv8z7tzu1s0RTqU-uMNuF4XsBgVq3WyidHTf0iVrtVovi2yQUdZtSdhk-dNXYfiWX2z8gsRZ33xIMHvNT-8h92q_7OKsQuLKDgiAX9DVoVGuBKSbowlvoAv8Nlqo_L61yCpsg Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 2ceaecc3b7fc4fed9dce1e3ab1014ed2 Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:00:08.541334 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:00:08.542702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}] Jul 12 04:00:08.542702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:08.542702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 2ceaecc3b7fc4fed9dce1e3ab1014ed2 Jul 12 04:00:08.542702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:08.542702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeTestJSON-21093929-project Jul 12 04:00:08.542702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:00:08.542702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:00:08.542702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: b10d2c10313c4be2a8c11cff1eed8852 Jul 12 04:00:08.542702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeTestJSON-21093929-project Jul 12 04:00:08.542702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:00:08.542702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:08.542702 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0'} Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:00:08.543448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:08.545203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:08.547408 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fcc8e7ec-a36c-42fc-92e3-38e2a3197a53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Returning 404 to user: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:00:08.547408 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-fcc8e7ec-a36c-42fc-92e3-38e2a3197a53 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 404 len: 111 microversion: 2.1 time: 0.033777 Jul 12 04:00:08.547408 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 494/1024] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:00:08 2022] DELETE /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:00:08.554304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-93e8f1c8-1ae8-491c-a86f-39350a225084 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:08.554956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-93e8f1c8-1ae8-491c-a86f-39350a225084 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:08.561205 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-93e8f1c8-1ae8-491c-a86f-39350a225084 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:08.561659 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-93e8f1c8-1ae8-491c-a86f-39350a225084 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:08.562469 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-93e8f1c8-1ae8-491c-a86f-39350a225084 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:08.562904 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-93e8f1c8-1ae8-491c-a86f-39350a225084 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:08.580140 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-93e8f1c8-1ae8-491c-a86f-39350a225084 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] HTTP exception thrown: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-93e8f1c8-1ae8-491c-a86f-39350a225084 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Request method failure captured: Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 HTTP/1.1 Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO-gJ7kDGy6dVaiKGKo8CX9Ky2cDF0Skq1U_TQB9CcUv8z7tzu1s0RTqU-uMNuF4XsBgVq3WyidHTf0iVrtVovi2yQUdZtSdhk-dNXYfiWX2z8gsRZ33xIMHvNT-8h92q_7OKsQuLKDgiAX9DVoVGuBKSbowlvoAv8Nlqo_L61yCpsg Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 2ceaecc3b7fc4fed9dce1e3ab1014ed2 Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:00:08.581746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:00:08.583446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}] Jul 12 04:00:08.583446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:08.583446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 2ceaecc3b7fc4fed9dce1e3ab1014ed2 Jul 12 04:00:08.583446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:08.583446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeTestJSON-21093929-project Jul 12 04:00:08.583446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:00:08.583446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:00:08.583446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: b10d2c10313c4be2a8c11cff1eed8852 Jul 12 04:00:08.583446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeTestJSON-21093929-project Jul 12 04:00:08.583446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:00:08.583446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:08.583446 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0'} Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:00:08.584506 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. Jul 12 04:00:08.585981 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:00:08.587676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-93e8f1c8-1ae8-491c-a86f-39350a225084 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Returning 404 to user: Instance b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:00:08.587676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-93e8f1c8-1ae8-491c-a86f-39350a225084 tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0" status: 404 len: 111 microversion: 2.1 time: 0.032756 Jul 12 04:00:08.587676 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 495/1025] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:08 2022] GET /compute/v2.1/servers/b9abe61b-8566-4a61-a4df-4ad7a0f8b3d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:00:08.711343 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c9dcdbc1-45ea-47f2-81ac-0489c8064377 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:08.719303 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c9dcdbc1-45ea-47f2-81ac-0489c8064377 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.201206 Jul 12 04:00:08.729341 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 531/1026] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:08 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:09.737123 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6cfecf20-23c4-479d-9de9-95c4d15707af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:09.738269 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6cfecf20-23c4-479d-9de9-95c4d15707af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:09.744850 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6cfecf20-23c4-479d-9de9-95c4d15707af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:09.745545 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6cfecf20-23c4-479d-9de9-95c4d15707af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:09.746512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6cfecf20-23c4-479d-9de9-95c4d15707af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:09.747104 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6cfecf20-23c4-479d-9de9-95c4d15707af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:09.763490 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ece001ba-5be3-4315-b723-0aee58a92fca tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:09.764114 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ece001ba-5be3-4315-b723-0aee58a92fca tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:09.771738 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ece001ba-5be3-4315-b723-0aee58a92fca tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:09.782444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ece001ba-5be3-4315-b723-0aee58a92fca tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:09.784295 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ece001ba-5be3-4315-b723-0aee58a92fca tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:09.784933 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ece001ba-5be3-4315-b723-0aee58a92fca tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:09.819883 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-ece001ba-5be3-4315-b723-0aee58a92fca tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] HTTP exception thrown: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ece001ba-5be3-4315-b723-0aee58a92fca tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Request method failure captured: Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: DELETE /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 HTTP/1.1 Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO-gJ7kDGy6dVaiKGKo8CX9Ky2cDF0Skq1U_TQB9CcUv8z7tzu1s0RTqU-uMNuF4XsBgVq3WyidHTf0iVrtVovi2yQUdZtSdhk-dNXYfiWX2z8gsRZ33xIMHvNT-8h92q_7OKsQuLKDgiAX9DVoVGuBKSbowlvoAv8Nlqo_L61yCpsg Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 2ceaecc3b7fc4fed9dce1e3ab1014ed2 Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:00:09.824426 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:00:09.826051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}] Jul 12 04:00:09.826051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:09.826051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 2ceaecc3b7fc4fed9dce1e3ab1014ed2 Jul 12 04:00:09.826051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:09.826051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-AttachVolumeTestJSON-21093929-project Jul 12 04:00:09.826051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:00:09.826051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:00:09.826051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: b10d2c10313c4be2a8c11cff1eed8852 Jul 12 04:00:09.826051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-AttachVolumeTestJSON-21093929-project Jul 12 04:00:09.826051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:00:09.826051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 04:00:09.826051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'e83ba0f3-55f9-4a38-9794-46bb9876f0d7'} Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:00:09.826828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 04:00:09.828376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:09.833935 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ece001ba-5be3-4315-b723-0aee58a92fca tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Returning 404 to user: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:00:09.833935 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ece001ba-5be3-4315-b723-0aee58a92fca tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 404 len: 111 microversion: 2.1 time: 0.068770 Jul 12 04:00:09.833935 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 532/1027] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:00:09 2022] DELETE /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:00:09.836847 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6d269070-c02f-4bfb-9ad7-42e1b0ffb9ff tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:09.837576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-6d269070-c02f-4bfb-9ad7-42e1b0ffb9ff tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] [instance: e83ba0f3-55f9-4a38-9794-46bb9876f0d7] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:09.843907 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6d269070-c02f-4bfb-9ad7-42e1b0ffb9ff tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:09.844431 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6d269070-c02f-4bfb-9ad7-42e1b0ffb9ff tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:09.845202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6d269070-c02f-4bfb-9ad7-42e1b0ffb9ff tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:09.845674 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6d269070-c02f-4bfb-9ad7-42e1b0ffb9ff tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:09.862912 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-6d269070-c02f-4bfb-9ad7-42e1b0ffb9ff tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] HTTP exception thrown: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6d269070-c02f-4bfb-9ad7-42e1b0ffb9ff tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Request method failure captured: Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 HTTP/1.1 Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO-gJ7kDGy6dVaiKGKo8CX9Ky2cDF0Skq1U_TQB9CcUv8z7tzu1s0RTqU-uMNuF4XsBgVq3WyidHTf0iVrtVovi2yQUdZtSdhk-dNXYfiWX2z8gsRZ33xIMHvNT-8h92q_7OKsQuLKDgiAX9DVoVGuBKSbowlvoAv8Nlqo_L61yCpsg Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 2ceaecc3b7fc4fed9dce1e3ab1014ed2 Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:00:09.864808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:00:09.866349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ceaecc3b7fc4fed9dce1e3ab1014ed2"}]}] Jul 12 04:00:09.866349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:09.866349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 2ceaecc3b7fc4fed9dce1e3ab1014ed2 Jul 12 04:00:09.866349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-AttachVolumeTestJSON-21093929 Jul 12 04:00:09.866349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-AttachVolumeTestJSON-21093929-project Jul 12 04:00:09.866349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:00:09.866349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:00:09.866349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: b10d2c10313c4be2a8c11cff1eed8852 Jul 12 04:00:09.866349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-AttachVolumeTestJSON-21093929-project Jul 12 04:00:09.866349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:00:09.866349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 04:00:09.866349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'e83ba0f3-55f9-4a38-9794-46bb9876f0d7'} Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:00:09.867123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. Jul 12 04:00:09.868444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:00:09.869528 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6d269070-c02f-4bfb-9ad7-42e1b0ffb9ff tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] Returning 404 to user: Instance e83ba0f3-55f9-4a38-9794-46bb9876f0d7 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:00:09.869528 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-6d269070-c02f-4bfb-9ad7-42e1b0ffb9ff tempest-AttachVolumeTestJSON-21093929 tempest-AttachVolumeTestJSON-21093929-project] 10.222.0.20 "GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7" status: 404 len: 111 microversion: 2.1 time: 0.033173 Jul 12 04:00:09.869528 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 533/1028] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:09 2022] GET /compute/v2.1/servers/e83ba0f3-55f9-4a38-9794-46bb9876f0d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:00:10.092297 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6cfecf20-23c4-479d-9de9-95c4d15707af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:10.100304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6cfecf20-23c4-479d-9de9-95c4d15707af tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.367871 Jul 12 04:00:10.101213 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 496/1029] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:09 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:11.119293 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-217e9c30-15ef-4e7c-9e25-cbdd6ce6635b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:11.120670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-217e9c30-15ef-4e7c-9e25-cbdd6ce6635b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:11.128366 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-217e9c30-15ef-4e7c-9e25-cbdd6ce6635b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:11.129183 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-217e9c30-15ef-4e7c-9e25-cbdd6ce6635b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:11.129973 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-217e9c30-15ef-4e7c-9e25-cbdd6ce6635b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:11.130409 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-217e9c30-15ef-4e7c-9e25-cbdd6ce6635b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:11.555635 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-217e9c30-15ef-4e7c-9e25-cbdd6ce6635b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:11.563358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-217e9c30-15ef-4e7c-9e25-cbdd6ce6635b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.448535 Jul 12 04:00:11.564258 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 534/1030] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:11 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:12.581509 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-430ab10b-e532-4186-8033-bcc5071870ba tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:12.582976 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-430ab10b-e532-4186-8033-bcc5071870ba tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:12.590280 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-430ab10b-e532-4186-8033-bcc5071870ba tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:12.591090 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-430ab10b-e532-4186-8033-bcc5071870ba tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:12.591931 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-430ab10b-e532-4186-8033-bcc5071870ba tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:12.592588 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-430ab10b-e532-4186-8033-bcc5071870ba tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:12.853799 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-430ab10b-e532-4186-8033-bcc5071870ba tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:12.861842 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-430ab10b-e532-4186-8033-bcc5071870ba tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.284698 Jul 12 04:00:12.871779 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 497/1031] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:12 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:13.470729 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-90635678-6712-4e48-a554-870013b0cc82 req-814468b2-3bb2-4af8-a927-dd1c4b2bb2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b74d356-e773-4d8b-85cf-b31c80c2aef3", "name": "network-vif-plugged", "status": "completed", "tag": "c31ca6c3-cf04-4828-a8bf-1c95239cd2d1"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:00:13.492047 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-90635678-6712-4e48-a554-870013b0cc82 req-814468b2-3bb2-4af8-a927-dd1c4b2bb2f3 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:13.492768 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-90635678-6712-4e48-a554-870013b0cc82 req-814468b2-3bb2-4af8-a927-dd1c4b2bb2f3 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:13.513071 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-90635678-6712-4e48-a554-870013b0cc82 req-814468b2-3bb2-4af8-a927-dd1c4b2bb2f3 service nova] Creating event network-vif-plugged:c31ca6c3-cf04-4828-a8bf-1c95239cd2d1 for instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3 on hv-cinder-84773 Jul 12 04:00:13.522131 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-90635678-6712-4e48-a554-870013b0cc82 req-814468b2-3bb2-4af8-a927-dd1c4b2bb2f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056201 Jul 12 04:00:13.523272 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 535/1032] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:00:13.879809 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-03dc9c8e-c983-4747-8fca-e9e9f17618f0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:13.880580 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-03dc9c8e-c983-4747-8fca-e9e9f17618f0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:13.904604 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-03dc9c8e-c983-4747-8fca-e9e9f17618f0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:13.907948 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-03dc9c8e-c983-4747-8fca-e9e9f17618f0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:13.908991 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-03dc9c8e-c983-4747-8fca-e9e9f17618f0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:13.909538 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-03dc9c8e-c983-4747-8fca-e9e9f17618f0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:14.131265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-03dc9c8e-c983-4747-8fca-e9e9f17618f0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:14.145134 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-03dc9c8e-c983-4747-8fca-e9e9f17618f0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.269653 Jul 12 04:00:14.146400 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 498/1033] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:13 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:15.167328 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-74f3a2d9-8222-4dfd-b734-72a266894014 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:15.167328 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-74f3a2d9-8222-4dfd-b734-72a266894014 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:15.181597 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-74f3a2d9-8222-4dfd-b734-72a266894014 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:15.183918 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-74f3a2d9-8222-4dfd-b734-72a266894014 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:15.187731 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-74f3a2d9-8222-4dfd-b734-72a266894014 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:15.188377 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-74f3a2d9-8222-4dfd-b734-72a266894014 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:15.388552 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-74f3a2d9-8222-4dfd-b734-72a266894014 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:15.401564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-74f3a2d9-8222-4dfd-b734-72a266894014 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1261 microversion: 2.1 time: 0.242152 Jul 12 04:00:15.404507 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 536/1034] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:15 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1261 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:16.420801 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-49a9c039-c482-4128-8cab-45b98f034f1a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:16.422160 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-49a9c039-c482-4128-8cab-45b98f034f1a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:16.430540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-49a9c039-c482-4128-8cab-45b98f034f1a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:16.431341 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-49a9c039-c482-4128-8cab-45b98f034f1a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:16.432319 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-49a9c039-c482-4128-8cab-45b98f034f1a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:16.432901 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-49a9c039-c482-4128-8cab-45b98f034f1a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:16.703789 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-49a9c039-c482-4128-8cab-45b98f034f1a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:16.712619 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-49a9c039-c482-4128-8cab-45b98f034f1a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1445 microversion: 2.1 time: 0.295866 Jul 12 04:00:16.713202 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 499/1035] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:16 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1445 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:16.728809 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4351c805-c720-45c6-8b23-c2b80142b59a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:16.729427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4351c805-c720-45c6-8b23-c2b80142b59a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:16.735959 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4351c805-c720-45c6-8b23-c2b80142b59a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:16.739550 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4351c805-c720-45c6-8b23-c2b80142b59a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:16.740766 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4351c805-c720-45c6-8b23-c2b80142b59a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:16.741228 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4351c805-c720-45c6-8b23-c2b80142b59a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:16.897667 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4351c805-c720-45c6-8b23-c2b80142b59a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:16.905780 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4351c805-c720-45c6-8b23-c2b80142b59a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1445 microversion: 2.1 time: 0.180785 Jul 12 04:00:16.906746 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 537/1036] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:16 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1445 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:17.693325 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-844dbc1e-3839-44b1-9315-3387f0df3c67 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: .version_select at 0x7fd7fa386310>, body: {"keypair": {"name": "tempest-keypair-52845919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPyeoe5hrkqmwjKGL0O6a1zTBXtfbQ1bQcd0v6gg9O/z839zFHswNMR7byYdT+GjuZ3orTFTf8mmx2qndFlzs36MBXPi5TK6Jb+CBcLgnsF91PqGlwumigKhfVB9AF6YQ=="}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:00:17.721549 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-844dbc1e-3839-44b1-9315-3387f0df3c67 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for project 5c29114118814a298f6337842ad29a9b. Resources: {'key_pairs'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 04:00:17.726615 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-844dbc1e-3839-44b1-9315-3387f0df3c67 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for user 0995483e7e7049bbb639ef3142192abe and project 5c29114118814a298f6337842ad29a9b. Resources: {'key_pairs'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 04:00:17.765167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-844dbc1e-3839-44b1-9315-3387f0df3c67 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.212492 Jul 12 04:00:17.766112 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 500/1037] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 04:00:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:00:19.401895 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-100625703", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56d544be-a0fe-4e9c-9375-791b0f38b322"}], "security_groups": [{"name": "tempest-securitygroup--1860763776"}], "key_name": "tempest-keypair-52845919", "user_data": "}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:00:19.421036 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-c4aee193-16f4-4f77-9a74-c93799e5ce2e req-a1064246-7b4d-4a22-ba93-c65be9c9119b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b74d356-e773-4d8b-85cf-b31c80c2aef3", "tag": "c31ca6c3-cf04-4828-a8bf-1c95239cd2d1"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:00:19.431151 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-c4aee193-16f4-4f77-9a74-c93799e5ce2e req-a1064246-7b4d-4a22-ba93-c65be9c9119b service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:19.431596 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-c4aee193-16f4-4f77-9a74-c93799e5ce2e req-a1064246-7b4d-4a22-ba93-c65be9c9119b service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:19.442589 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-c4aee193-16f4-4f77-9a74-c93799e5ce2e req-a1064246-7b4d-4a22-ba93-c65be9c9119b service nova] Creating event network-changed:c31ca6c3-cf04-4828-a8bf-1c95239cd2d1 for instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3 on hv-cinder-84773 Jul 12 04:00:19.448339 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-c4aee193-16f4-4f77-9a74-c93799e5ce2e req-a1064246-7b4d-4a22-ba93-c65be9c9119b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031923 Jul 12 04:00:19.449461 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 501/1038] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 04:00:19.515459 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.network.neutron [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] validate_networks() for [('56d544be-a0fe-4e9c-9375-791b0f38b322', None, None, None, None, None)] {{(pid=124434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 04:00:19.995094 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Flavor limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 04:00:19.996246 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Image limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 04:00:19.996957 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Flavor pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 04:00:19.997724 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Image pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 04:00:19.998490 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 04:00:20.010397 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:20.011190 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:20.012181 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:20.012812 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:20.040945 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for project 5c29114118814a298f6337842ad29a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 04:00:20.049317 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for user 0995483e7e7049bbb639ef3142192abe and project 5c29114118814a298f6337842ad29a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 04:00:20.061769 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Going to run 1 instances... {{(pid=124434) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 04:00:20.064376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 04:00:20.122914 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-25e32447-eb91-4852-9e19-de366b5ed66c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.725658 Jul 12 04:00:20.124376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 538/1039] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 04:00:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 04:00:20.135101 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-13fb119a-b707-4406-85e7-50ef01d78148 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:20.135786 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-13fb119a-b707-4406-85e7-50ef01d78148 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:20.218613 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-13fb119a-b707-4406-85e7-50ef01d78148 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:20.236689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-13fb119a-b707-4406-85e7-50ef01d78148 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1239 microversion: 2.1 time: 0.105957 Jul 12 04:00:20.246638 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 502/1040] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:20 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1239 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:21.254743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-20b0e619-ebbb-4b55-b042-5ed13f80aba0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:21.256657 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-20b0e619-ebbb-4b55-b042-5ed13f80aba0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:21.265620 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-20b0e619-ebbb-4b55-b042-5ed13f80aba0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:21.266276 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-20b0e619-ebbb-4b55-b042-5ed13f80aba0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:21.267184 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-20b0e619-ebbb-4b55-b042-5ed13f80aba0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:21.267724 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-20b0e619-ebbb-4b55-b042-5ed13f80aba0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:21.333984 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-20b0e619-ebbb-4b55-b042-5ed13f80aba0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:21.341661 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-20b0e619-ebbb-4b55-b042-5ed13f80aba0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1243 microversion: 2.1 time: 0.091295 Jul 12 04:00:21.342242 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 539/1041] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:21 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1243 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:22.358618 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-756b251a-a58d-4564-b233-c960c2dd196d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:22.359307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-756b251a-a58d-4564-b233-c960c2dd196d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:22.367015 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-756b251a-a58d-4564-b233-c960c2dd196d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:22.367442 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-756b251a-a58d-4564-b233-c960c2dd196d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:22.368264 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-756b251a-a58d-4564-b233-c960c2dd196d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:22.368705 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-756b251a-a58d-4564-b233-c960c2dd196d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:22.430844 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-756b251a-a58d-4564-b233-c960c2dd196d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:22.438439 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-756b251a-a58d-4564-b233-c960c2dd196d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1235 microversion: 2.1 time: 0.083786 Jul 12 04:00:22.439017 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 503/1042] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:22 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1235 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 04:00:23.455378 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f4d5dec0-bcdd-42e4-8c92-47a9998eb869 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:23.455984 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f4d5dec0-bcdd-42e4-8c92-47a9998eb869 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:23.462260 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f4d5dec0-bcdd-42e4-8c92-47a9998eb869 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:23.462909 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f4d5dec0-bcdd-42e4-8c92-47a9998eb869 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:23.464039 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f4d5dec0-bcdd-42e4-8c92-47a9998eb869 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:23.464654 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f4d5dec0-bcdd-42e4-8c92-47a9998eb869 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:23.538055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f4d5dec0-bcdd-42e4-8c92-47a9998eb869 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:23.546515 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f4d5dec0-bcdd-42e4-8c92-47a9998eb869 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1297 microversion: 2.1 time: 0.095138 Jul 12 04:00:23.547261 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 540/1043] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:23 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:24.564970 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-227d42db-1fc5-459f-a00e-c232216bf59f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:24.566529 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-227d42db-1fc5-459f-a00e-c232216bf59f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:24.573804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-227d42db-1fc5-459f-a00e-c232216bf59f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:24.574475 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-227d42db-1fc5-459f-a00e-c232216bf59f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:24.576480 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-227d42db-1fc5-459f-a00e-c232216bf59f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:24.577103 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-227d42db-1fc5-459f-a00e-c232216bf59f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:24.577991 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-3daf26d2-f777-4451-a155-ab2826426cbe req-27c46d3d-9230-4183-9503-a052deb411b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87f737c-428c-4c33-9622-1cb03773adf4", "tag": "f0b8da74-d9c0-440b-99ef-0147b592ae3d"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:00:24.594511 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:24.596906 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-3daf26d2-f777-4451-a155-ab2826426cbe req-27c46d3d-9230-4183-9503-a052deb411b0 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:24.597524 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-3daf26d2-f777-4451-a155-ab2826426cbe req-27c46d3d-9230-4183-9503-a052deb411b0 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:24.610816 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-3daf26d2-f777-4451-a155-ab2826426cbe req-27c46d3d-9230-4183-9503-a052deb411b0 service nova] Creating event network-changed:f0b8da74-d9c0-440b-99ef-0147b592ae3d for instance a87f737c-428c-4c33-9622-1cb03773adf4 on hv-cinder-84773 Jul 12 04:00:24.616454 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-3daf26d2-f777-4451-a155-ab2826426cbe req-27c46d3d-9230-4183-9503-a052deb411b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042631 Jul 12 04:00:24.617298 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 541/1044] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:00:24.725303 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-227d42db-1fc5-459f-a00e-c232216bf59f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:24.733182 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-227d42db-1fc5-459f-a00e-c232216bf59f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.172086 Jul 12 04:00:24.733783 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 504/1045] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:24 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:25.752887 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a1ea1467-0019-46ae-ace2-751b7dabfd03 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:25.753696 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a1ea1467-0019-46ae-ace2-751b7dabfd03 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:25.762780 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a1ea1467-0019-46ae-ace2-751b7dabfd03 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:25.763310 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a1ea1467-0019-46ae-ace2-751b7dabfd03 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:25.764240 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a1ea1467-0019-46ae-ace2-751b7dabfd03 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:25.764756 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a1ea1467-0019-46ae-ace2-751b7dabfd03 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:25.916062 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a1ea1467-0019-46ae-ace2-751b7dabfd03 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:25.927217 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a1ea1467-0019-46ae-ace2-751b7dabfd03 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.179981 Jul 12 04:00:25.927938 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 542/1046] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:25 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:26.951686 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6256d204-287c-4e67-a689-ab7c5ef3ff94 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:26.952599 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6256d204-287c-4e67-a689-ab7c5ef3ff94 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:26.963729 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6256d204-287c-4e67-a689-ab7c5ef3ff94 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:26.964532 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6256d204-287c-4e67-a689-ab7c5ef3ff94 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:26.965794 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6256d204-287c-4e67-a689-ab7c5ef3ff94 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:26.966518 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6256d204-287c-4e67-a689-ab7c5ef3ff94 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:27.098373 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6256d204-287c-4e67-a689-ab7c5ef3ff94 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:27.106234 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6256d204-287c-4e67-a689-ab7c5ef3ff94 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.161221 Jul 12 04:00:27.106778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 505/1047] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:26 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:28.122981 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4ba2d896-7257-487c-8c77-0a27b6d21db2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:28.123723 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4ba2d896-7257-487c-8c77-0a27b6d21db2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:28.130556 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4ba2d896-7257-487c-8c77-0a27b6d21db2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:28.131066 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4ba2d896-7257-487c-8c77-0a27b6d21db2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:28.131831 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4ba2d896-7257-487c-8c77-0a27b6d21db2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:28.132302 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4ba2d896-7257-487c-8c77-0a27b6d21db2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:28.265577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4ba2d896-7257-487c-8c77-0a27b6d21db2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:28.273211 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4ba2d896-7257-487c-8c77-0a27b6d21db2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.154165 Jul 12 04:00:28.273764 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 543/1048] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:28 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:29.297804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7cdccfc4-9516-4ee5-a216-aaa4f40ba814 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:29.298424 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7cdccfc4-9516-4ee5-a216-aaa4f40ba814 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:29.305843 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7cdccfc4-9516-4ee5-a216-aaa4f40ba814 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:29.306312 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7cdccfc4-9516-4ee5-a216-aaa4f40ba814 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:29.307126 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7cdccfc4-9516-4ee5-a216-aaa4f40ba814 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:29.307577 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7cdccfc4-9516-4ee5-a216-aaa4f40ba814 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:29.311943 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=100 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:29.454212 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-7cdccfc4-9516-4ee5-a216-aaa4f40ba814 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:29.461944 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7cdccfc4-9516-4ee5-a216-aaa4f40ba814 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.171039 Jul 12 04:00:29.462484 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 506/1049] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:29 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:30.479134 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a33a6e4e-7cc7-471d-bc95-72e914f18901 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:30.479864 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a33a6e4e-7cc7-471d-bc95-72e914f18901 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:30.482233 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:30.482906 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=6 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:30.491600 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a33a6e4e-7cc7-471d-bc95-72e914f18901 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:30.492351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a33a6e4e-7cc7-471d-bc95-72e914f18901 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:30.493614 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a33a6e4e-7cc7-471d-bc95-72e914f18901 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:30.494338 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a33a6e4e-7cc7-471d-bc95-72e914f18901 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:30.646108 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a33a6e4e-7cc7-471d-bc95-72e914f18901 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:30.653815 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a33a6e4e-7cc7-471d-bc95-72e914f18901 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.178632 Jul 12 04:00:30.654317 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 544/1050] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:30 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:31.672544 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-4157e564-1aae-4a74-852a-6a75f5a6ddb4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:31.673389 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-4157e564-1aae-4a74-852a-6a75f5a6ddb4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:31.675186 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=6 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:31.680969 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4157e564-1aae-4a74-852a-6a75f5a6ddb4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:31.681413 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4157e564-1aae-4a74-852a-6a75f5a6ddb4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:31.682188 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4157e564-1aae-4a74-852a-6a75f5a6ddb4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:31.682626 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-4157e564-1aae-4a74-852a-6a75f5a6ddb4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:31.821420 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-4157e564-1aae-4a74-852a-6a75f5a6ddb4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:31.829055 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-4157e564-1aae-4a74-852a-6a75f5a6ddb4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.160966 Jul 12 04:00:31.829649 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 507/1051] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:31 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:32.849941 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2dcd33d6-afbb-43b9-ba77-87d23c6b6ec9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:32.850907 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2dcd33d6-afbb-43b9-ba77-87d23c6b6ec9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:32.862016 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2dcd33d6-afbb-43b9-ba77-87d23c6b6ec9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:32.862759 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2dcd33d6-afbb-43b9-ba77-87d23c6b6ec9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:32.864313 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2dcd33d6-afbb-43b9-ba77-87d23c6b6ec9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:32.865033 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2dcd33d6-afbb-43b9-ba77-87d23c6b6ec9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:33.006158 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-2dcd33d6-afbb-43b9-ba77-87d23c6b6ec9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:33.014002 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2dcd33d6-afbb-43b9-ba77-87d23c6b6ec9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.170623 Jul 12 04:00:33.014544 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 545/1052] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:32 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:34.036793 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-55bf8ca1-916a-4715-a9c8-a2261b7a194f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:34.037833 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-55bf8ca1-916a-4715-a9c8-a2261b7a194f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:34.049174 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-55bf8ca1-916a-4715-a9c8-a2261b7a194f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:34.049625 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-55bf8ca1-916a-4715-a9c8-a2261b7a194f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:34.050396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-55bf8ca1-916a-4715-a9c8-a2261b7a194f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:34.050833 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-55bf8ca1-916a-4715-a9c8-a2261b7a194f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:34.186849 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-55bf8ca1-916a-4715-a9c8-a2261b7a194f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:34.195344 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-55bf8ca1-916a-4715-a9c8-a2261b7a194f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.165715 Jul 12 04:00:34.195950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 508/1053] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:34 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:35.215902 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8e6856dc-b0a4-4dec-83da-f87a926bdbce tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:35.216882 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8e6856dc-b0a4-4dec-83da-f87a926bdbce tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:35.225673 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8e6856dc-b0a4-4dec-83da-f87a926bdbce tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:35.226117 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8e6856dc-b0a4-4dec-83da-f87a926bdbce tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:35.226872 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8e6856dc-b0a4-4dec-83da-f87a926bdbce tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:35.227302 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8e6856dc-b0a4-4dec-83da-f87a926bdbce tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:35.378191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8e6856dc-b0a4-4dec-83da-f87a926bdbce tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:35.385953 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8e6856dc-b0a4-4dec-83da-f87a926bdbce tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.176805 Jul 12 04:00:35.386775 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 546/1054] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:35 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:36.404414 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9797a6c9-86a5-436f-bca1-eb94e360cb6a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:36.405203 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9797a6c9-86a5-436f-bca1-eb94e360cb6a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:36.408830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:36.412746 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9797a6c9-86a5-436f-bca1-eb94e360cb6a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:36.413199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9797a6c9-86a5-436f-bca1-eb94e360cb6a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:36.413960 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9797a6c9-86a5-436f-bca1-eb94e360cb6a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:36.414417 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9797a6c9-86a5-436f-bca1-eb94e360cb6a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:36.552297 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-9797a6c9-86a5-436f-bca1-eb94e360cb6a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:36.562457 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9797a6c9-86a5-436f-bca1-eb94e360cb6a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.161826 Jul 12 04:00:36.563221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 509/1055] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:36 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:36.722476 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-c94113ad-ba40-4bff-9437-14339beffbe4 req-96ceec12-31c3-4ec8-be4a-1f0f1d383728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87f737c-428c-4c33-9622-1cb03773adf4", "name": "network-vif-plugged", "status": "completed", "tag": "f0b8da74-d9c0-440b-99ef-0147b592ae3d"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:00:36.731577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-c94113ad-ba40-4bff-9437-14339beffbe4 req-96ceec12-31c3-4ec8-be4a-1f0f1d383728 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:36.732058 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-c94113ad-ba40-4bff-9437-14339beffbe4 req-96ceec12-31c3-4ec8-be4a-1f0f1d383728 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:36.744522 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-c94113ad-ba40-4bff-9437-14339beffbe4 req-96ceec12-31c3-4ec8-be4a-1f0f1d383728 service nova] Creating event network-vif-plugged:f0b8da74-d9c0-440b-99ef-0147b592ae3d for instance a87f737c-428c-4c33-9622-1cb03773adf4 on hv-cinder-84773 Jul 12 04:00:36.749589 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-c94113ad-ba40-4bff-9437-14339beffbe4 req-96ceec12-31c3-4ec8-be4a-1f0f1d383728 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031019 Jul 12 04:00:36.750342 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 547/1056] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:00:37.578778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-c9d42e34-c892-4a3b-bbae-89c6b85a353a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:37.579394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-c9d42e34-c892-4a3b-bbae-89c6b85a353a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:37.586423 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c9d42e34-c892-4a3b-bbae-89c6b85a353a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:37.586899 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c9d42e34-c892-4a3b-bbae-89c6b85a353a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:37.587653 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c9d42e34-c892-4a3b-bbae-89c6b85a353a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:37.588098 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-c9d42e34-c892-4a3b-bbae-89c6b85a353a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:37.725893 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-c9d42e34-c892-4a3b-bbae-89c6b85a353a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:37.739941 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-c9d42e34-c892-4a3b-bbae-89c6b85a353a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.165030 Jul 12 04:00:37.740666 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 510/1057] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:37 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:38.758390 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5bef55e2-2eb9-442b-bb3b-fced94ba82d7 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:38.759168 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5bef55e2-2eb9-442b-bb3b-fced94ba82d7 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:38.767064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5bef55e2-2eb9-442b-bb3b-fced94ba82d7 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:38.767596 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5bef55e2-2eb9-442b-bb3b-fced94ba82d7 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:38.768455 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5bef55e2-2eb9-442b-bb3b-fced94ba82d7 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:38.768946 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5bef55e2-2eb9-442b-bb3b-fced94ba82d7 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:38.771955 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=83 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:00:38.906476 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5bef55e2-2eb9-442b-bb3b-fced94ba82d7 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:38.914601 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5bef55e2-2eb9-442b-bb3b-fced94ba82d7 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.161012 Jul 12 04:00:38.915121 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 548/1058] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:38 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:39.935439 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-84785ffd-e731-4bf4-a535-0b31aa581790 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:39.936483 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-84785ffd-e731-4bf4-a535-0b31aa581790 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:39.947822 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-84785ffd-e731-4bf4-a535-0b31aa581790 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:39.948589 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-84785ffd-e731-4bf4-a535-0b31aa581790 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:39.949900 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-84785ffd-e731-4bf4-a535-0b31aa581790 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:39.950627 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-84785ffd-e731-4bf4-a535-0b31aa581790 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:40.092477 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-84785ffd-e731-4bf4-a535-0b31aa581790 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:40.103808 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-84785ffd-e731-4bf4-a535-0b31aa581790 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.174670 Jul 12 04:00:40.104659 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 511/1059] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:39 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:41.130036 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-bc99ace9-12e9-428a-9144-ad1448d3c61d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:41.130618 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-bc99ace9-12e9-428a-9144-ad1448d3c61d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:41.138015 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bc99ace9-12e9-428a-9144-ad1448d3c61d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:41.138503 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bc99ace9-12e9-428a-9144-ad1448d3c61d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:41.139292 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bc99ace9-12e9-428a-9144-ad1448d3c61d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:41.139747 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bc99ace9-12e9-428a-9144-ad1448d3c61d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:41.270211 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-bc99ace9-12e9-428a-9144-ad1448d3c61d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:41.278334 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-bc99ace9-12e9-428a-9144-ad1448d3c61d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.154014 Jul 12 04:00:41.278911 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 549/1060] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:41 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:42.300041 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8b56e220-a579-4e43-9b8e-9070474e7923 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:42.300742 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8b56e220-a579-4e43-9b8e-9070474e7923 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:42.309381 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8b56e220-a579-4e43-9b8e-9070474e7923 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:42.309943 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8b56e220-a579-4e43-9b8e-9070474e7923 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:42.310912 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8b56e220-a579-4e43-9b8e-9070474e7923 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:42.311459 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8b56e220-a579-4e43-9b8e-9070474e7923 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:42.453033 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8b56e220-a579-4e43-9b8e-9070474e7923 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:42.460959 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8b56e220-a579-4e43-9b8e-9070474e7923 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.167779 Jul 12 04:00:42.461505 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 512/1061] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:42 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:43.484259 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8ea3a71e-d224-45df-920b-3a82e40a9ddf tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:43.485213 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8ea3a71e-d224-45df-920b-3a82e40a9ddf tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:43.493306 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8ea3a71e-d224-45df-920b-3a82e40a9ddf tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:43.493768 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8ea3a71e-d224-45df-920b-3a82e40a9ddf tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:43.494535 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8ea3a71e-d224-45df-920b-3a82e40a9ddf tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:43.494965 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8ea3a71e-d224-45df-920b-3a82e40a9ddf tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:43.628418 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-8ea3a71e-d224-45df-920b-3a82e40a9ddf tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:43.635881 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8ea3a71e-d224-45df-920b-3a82e40a9ddf tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1365 microversion: 2.1 time: 0.160226 Jul 12 04:00:43.636487 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 550/1062] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:43 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:44.656213 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ae4e03c1-6e13-43bd-b337-fb33da7ebc3f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:44.657196 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ae4e03c1-6e13-43bd-b337-fb33da7ebc3f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:44.666399 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae4e03c1-6e13-43bd-b337-fb33da7ebc3f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:44.666913 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae4e03c1-6e13-43bd-b337-fb33da7ebc3f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:44.667714 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae4e03c1-6e13-43bd-b337-fb33da7ebc3f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:44.668186 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae4e03c1-6e13-43bd-b337-fb33da7ebc3f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:44.819959 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ae4e03c1-6e13-43bd-b337-fb33da7ebc3f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:00:44.827775 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ae4e03c1-6e13-43bd-b337-fb33da7ebc3f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1556 microversion: 2.1 time: 0.178110 Jul 12 04:00:44.828414 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 513/1063] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:00:44 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:00:44.844122 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b590d975-e87a-4420-ba52-14f837d23946 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:00:44.844688 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b590d975-e87a-4420-ba52-14f837d23946 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:00:44.851325 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b590d975-e87a-4420-ba52-14f837d23946 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:44.851764 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b590d975-e87a-4420-ba52-14f837d23946 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:44.852548 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b590d975-e87a-4420-ba52-14f837d23946 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:44.852977 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b590d975-e87a-4420-ba52-14f837d23946 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:44.935623 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b590d975-e87a-4420-ba52-14f837d23946 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095075 Jul 12 04:00:44.936485 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 551/1064] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 04:00:44 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:00:46.218115 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-f8c2eaed-a8a4-4239-9e66-4b399f2e9a78 req-1a861c47-35ae-4942-8d68-1d09b8e2f887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87f737c-428c-4c33-9622-1cb03773adf4", "tag": "f0b8da74-d9c0-440b-99ef-0147b592ae3d"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:00:46.226340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-f8c2eaed-a8a4-4239-9e66-4b399f2e9a78 req-1a861c47-35ae-4942-8d68-1d09b8e2f887 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:00:46.226778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-f8c2eaed-a8a4-4239-9e66-4b399f2e9a78 req-1a861c47-35ae-4942-8d68-1d09b8e2f887 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:00:46.239817 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-f8c2eaed-a8a4-4239-9e66-4b399f2e9a78 req-1a861c47-35ae-4942-8d68-1d09b8e2f887 service nova] Creating event network-changed:f0b8da74-d9c0-440b-99ef-0147b592ae3d for instance a87f737c-428c-4c33-9622-1cb03773adf4 on hv-cinder-84773 Jul 12 04:00:46.244938 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-f8c2eaed-a8a4-4239-9e66-4b399f2e9a78 req-1a861c47-35ae-4942-8d68-1d09b8e2f887 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085555 Jul 12 04:00:46.245496 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 514/1065] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:01:09.439973 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=21 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:01:09.440814 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=21 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:01:09.445102 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-dbbf18e7-9c78-40ea-991b-ec33ceada27e req-b5954c8d-df6d-4543-8ffe-3627b03b4f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4933f1e-effd-46fc-8b69-a50bdc419106", "tag": "b54c3cd0-0543-4605-8bcb-366ec7d32882"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:01:09.445605 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-315226b5-952a-471e-bd0e-b05f776bf740 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:09.445837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-315226b5-952a-471e-bd0e-b05f776bf740 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:09.450126 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=11 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:01:09.451263 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=48 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:01:09.455879 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-315226b5-952a-471e-bd0e-b05f776bf740 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:09.456364 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-315226b5-952a-471e-bd0e-b05f776bf740 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:09.457336 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-315226b5-952a-471e-bd0e-b05f776bf740 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:09.457779 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-315226b5-952a-471e-bd0e-b05f776bf740 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:09.458807 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-dbbf18e7-9c78-40ea-991b-ec33ceada27e req-b5954c8d-df6d-4543-8ffe-3627b03b4f73 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:09.459328 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-dbbf18e7-9c78-40ea-991b-ec33ceada27e req-b5954c8d-df6d-4543-8ffe-3627b03b4f73 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:09.471645 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-dbbf18e7-9c78-40ea-991b-ec33ceada27e req-b5954c8d-df6d-4543-8ffe-3627b03b4f73 service nova] Creating event network-changed:b54c3cd0-0543-4605-8bcb-366ec7d32882 for instance e4933f1e-effd-46fc-8b69-a50bdc419106 on hv-cinder-84773 Jul 12 04:01:09.477773 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-dbbf18e7-9c78-40ea-991b-ec33ceada27e req-b5954c8d-df6d-4543-8ffe-3627b03b4f73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037917 Jul 12 04:01:09.478689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 515/1066] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:01:09.485916 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-315226b5-952a-471e-bd0e-b05f776bf740 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Going to try to terminate instance {{(pid=124434) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 04:01:09.569023 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-315226b5-952a-471e-bd0e-b05f776bf740 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 204 len: 0 microversion: 2.1 time: 0.130373 Jul 12 04:01:09.573538 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 552/1067] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:01:09 2022] DELETE /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 04:01:09.586341 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f4e7076c-ac2c-46d7-858f-a0a236465347 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:09.587743 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f4e7076c-ac2c-46d7-858f-a0a236465347 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:09.594691 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f4e7076c-ac2c-46d7-858f-a0a236465347 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:09.595147 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f4e7076c-ac2c-46d7-858f-a0a236465347 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:09.595922 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f4e7076c-ac2c-46d7-858f-a0a236465347 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:09.596391 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f4e7076c-ac2c-46d7-858f-a0a236465347 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:09.743704 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f4e7076c-ac2c-46d7-858f-a0a236465347 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:01:09.753775 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f4e7076c-ac2c-46d7-858f-a0a236465347 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1576 microversion: 2.1 time: 0.178508 Jul 12 04:01:09.754356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 516/1068] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:01:09 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 04:01:10.772151 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-036d4d80-7d69-4658-a36f-06cacd3fec40 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:10.772822 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-036d4d80-7d69-4658-a36f-06cacd3fec40 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:10.779796 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-036d4d80-7d69-4658-a36f-06cacd3fec40 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:10.780283 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-036d4d80-7d69-4658-a36f-06cacd3fec40 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:10.781053 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-036d4d80-7d69-4658-a36f-06cacd3fec40 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:10.781482 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-036d4d80-7d69-4658-a36f-06cacd3fec40 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:10.921631 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-036d4d80-7d69-4658-a36f-06cacd3fec40 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:01:10.929812 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-036d4d80-7d69-4658-a36f-06cacd3fec40 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1576 microversion: 2.1 time: 0.162114 Jul 12 04:01:10.930582 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 553/1069] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:01:10 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:01:11.948998 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ceaba263-a6ec-4efe-91d5-c9839b9a4995 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:11.949588 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ceaba263-a6ec-4efe-91d5-c9839b9a4995 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:11.956913 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ceaba263-a6ec-4efe-91d5-c9839b9a4995 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:11.957392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ceaba263-a6ec-4efe-91d5-c9839b9a4995 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:11.958222 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ceaba263-a6ec-4efe-91d5-c9839b9a4995 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:11.958778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ceaba263-a6ec-4efe-91d5-c9839b9a4995 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:12.171073 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ceaba263-a6ec-4efe-91d5-c9839b9a4995 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:01:12.180105 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ceaba263-a6ec-4efe-91d5-c9839b9a4995 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1458 microversion: 2.1 time: 0.235708 Jul 12 04:01:12.181402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 517/1070] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:01:11 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1458 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:01:12.516900 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-fc1a85da-fc2e-4455-adf0-6e6fa9855e7d req-049f0614-4d0a-41a7-a641-36da6a029e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4933f1e-effd-46fc-8b69-a50bdc419106", "name": "network-vif-deleted", "tag": "b54c3cd0-0543-4605-8bcb-366ec7d32882"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:01:12.527263 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-fc1a85da-fc2e-4455-adf0-6e6fa9855e7d req-049f0614-4d0a-41a7-a641-36da6a029e6a service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:12.527711 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-fc1a85da-fc2e-4455-adf0-6e6fa9855e7d req-049f0614-4d0a-41a7-a641-36da6a029e6a service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:12.540159 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-fc1a85da-fc2e-4455-adf0-6e6fa9855e7d req-049f0614-4d0a-41a7-a641-36da6a029e6a service nova] Creating event network-vif-deleted:b54c3cd0-0543-4605-8bcb-366ec7d32882 for instance e4933f1e-effd-46fc-8b69-a50bdc419106 on hv-cinder-84773 Jul 12 04:01:12.545192 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-fc1a85da-fc2e-4455-adf0-6e6fa9855e7d req-049f0614-4d0a-41a7-a641-36da6a029e6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031897 Jul 12 04:01:12.545687 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 554/1071] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:01:13.199812 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-899aae93-fc77-4674-8a55-fecc1e18e9c8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:13.200447 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-899aae93-fc77-4674-8a55-fecc1e18e9c8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:13.207385 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-899aae93-fc77-4674-8a55-fecc1e18e9c8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:13.207834 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-899aae93-fc77-4674-8a55-fecc1e18e9c8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:13.208648 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-899aae93-fc77-4674-8a55-fecc1e18e9c8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:13.209081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-899aae93-fc77-4674-8a55-fecc1e18e9c8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:13.241644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-899aae93-fc77-4674-8a55-fecc1e18e9c8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:13.242089 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-899aae93-fc77-4674-8a55-fecc1e18e9c8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:13.242522 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.objects.instance [None req-899aae93-fc77-4674-8a55-fecc1e18e9c8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lazy-loading 'fault' on Instance uuid e4933f1e-effd-46fc-8b69-a50bdc419106 {{(pid=124435) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 04:01:13.285341 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-899aae93-fc77-4674-8a55-fecc1e18e9c8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:01:13.293408 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-899aae93-fc77-4674-8a55-fecc1e18e9c8 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 200 len: 1229 microversion: 2.1 time: 0.098424 Jul 12 04:01:13.294017 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 518/1072] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:01:13 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:01:14.311630 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-47133d1a-845d-480a-a729-a4dcff88488e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:14.312388 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-47133d1a-845d-480a-a729-a4dcff88488e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: e4933f1e-effd-46fc-8b69-a50bdc419106] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:14.319572 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-47133d1a-845d-480a-a729-a4dcff88488e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:14.320051 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-47133d1a-845d-480a-a729-a4dcff88488e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:14.320830 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-47133d1a-845d-480a-a729-a4dcff88488e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:14.321321 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-47133d1a-845d-480a-a729-a4dcff88488e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:14.341286 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-47133d1a-845d-480a-a729-a4dcff88488e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] HTTP exception thrown: Instance e4933f1e-effd-46fc-8b69-a50bdc419106 could not be found. Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-47133d1a-845d-480a-a729-a4dcff88488e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Request method failure captured: Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 HTTP/1.1 Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO-8dpqzFzcrMCwqDwKjSU2VKruOD36zfE4WUHD_UvZUXRjz_J21oJmVhAiu7kpxRHTvSZNc1KEs2RJnDGiiNwCVQTjz6Ue8nGMcLQsM6XF3zmKzP_EBrxmIwgay9qHtOmCbmvpx8bbBjSxehF3uy9s0OVGu4VRKaONcH2bTLous7NI Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 99d9e85c63234c77889f856bf95288f5 Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-TestVolumeBootPattern-1773194956 Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:01:14.343111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:01:14.344824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99d9e85c63234c77889f856bf95288f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99d9e85c63234c77889f856bf95288f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99d9e85c63234c77889f856bf95288f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99d9e85c63234c77889f856bf95288f5"}]}] Jul 12 04:01:14.344824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-TestVolumeBootPattern-1773194956 Jul 12 04:01:14.344824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 99d9e85c63234c77889f856bf95288f5 Jul 12 04:01:14.344824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-TestVolumeBootPattern-1773194956 Jul 12 04:01:14.344824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-TestVolumeBootPattern-1773194956-project Jul 12 04:01:14.344824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:01:14.344824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:01:14.344824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 46d5c3f98d924538a34c4b3a57fcac14 Jul 12 04:01:14.344824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-TestVolumeBootPattern-1773194956-project Jul 12 04:01:14.344824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:01:14.344824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance e4933f1e-effd-46fc-8b69-a50bdc419106 could not be found. Jul 12 04:01:14.344824 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'e4933f1e-effd-46fc-8b69-a50bdc419106'} Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4933f1e-effd-46fc-8b69-a50bdc419106 could not be found. Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:01:14.346305 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4933f1e-effd-46fc-8b69-a50bdc419106 could not be found. Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4933f1e-effd-46fc-8b69-a50bdc419106 could not be found. Jul 12 04:01:14.348358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:14.350381 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-47133d1a-845d-480a-a729-a4dcff88488e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Returning 404 to user: Instance e4933f1e-effd-46fc-8b69-a50bdc419106 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:01:14.350381 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-47133d1a-845d-480a-a729-a4dcff88488e tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106" status: 404 len: 111 microversion: 2.1 time: 0.037787 Jul 12 04:01:14.350381 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 555/1073] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:01:14 2022] GET /compute/v2.1/servers/e4933f1e-effd-46fc-8b69-a50bdc419106 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:01:18.751361 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-9a35507d-64ee-49dc-9e73-a4964f43b85b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:18.751883 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9a35507d-64ee-49dc-9e73-a4964f43b85b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:18.757136 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-09ef4ed1-a2a3-4354-9f78-c4e21109c435 req-1a370e4e-1bbd-4c35-a118-e4205a6673d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "235a37d4-1517-4ea0-ab89-8b63a0413983", "tag": "a2e41b8a-4d2a-40b4-904c-82ef5d61e3b3"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:01:18.766952 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9a35507d-64ee-49dc-9e73-a4964f43b85b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:18.767168 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-09ef4ed1-a2a3-4354-9f78-c4e21109c435 req-1a370e4e-1bbd-4c35-a118-e4205a6673d3 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:18.767380 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9a35507d-64ee-49dc-9e73-a4964f43b85b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:18.767586 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-09ef4ed1-a2a3-4354-9f78-c4e21109c435 req-1a370e4e-1bbd-4c35-a118-e4205a6673d3 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:18.768396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9a35507d-64ee-49dc-9e73-a4964f43b85b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:18.769023 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-9a35507d-64ee-49dc-9e73-a4964f43b85b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:18.781003 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-09ef4ed1-a2a3-4354-9f78-c4e21109c435 req-1a370e4e-1bbd-4c35-a118-e4205a6673d3 service nova] Creating event network-changed:a2e41b8a-4d2a-40b4-904c-82ef5d61e3b3 for instance 235a37d4-1517-4ea0-ab89-8b63a0413983 on hv-cinder-84773 Jul 12 04:01:18.786385 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-09ef4ed1-a2a3-4354-9f78-c4e21109c435 req-1a370e4e-1bbd-4c35-a118-e4205a6673d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032891 Jul 12 04:01:18.787210 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 556/1074] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:01:18.796606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-9a35507d-64ee-49dc-9e73-a4964f43b85b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 04:01:18.890083 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-9a35507d-64ee-49dc-9e73-a4964f43b85b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "DELETE /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 204 len: 0 microversion: 2.1 time: 0.142481 Jul 12 04:01:18.893842 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 519/1075] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:01:18 2022] DELETE /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 04:01:18.900135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-385ac485-00ac-42e9-a185-b2738caddcd0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:18.900913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-385ac485-00ac-42e9-a185-b2738caddcd0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:18.907800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-385ac485-00ac-42e9-a185-b2738caddcd0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:18.908370 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-385ac485-00ac-42e9-a185-b2738caddcd0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:18.909205 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-385ac485-00ac-42e9-a185-b2738caddcd0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:18.910070 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-385ac485-00ac-42e9-a185-b2738caddcd0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:19.047264 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-385ac485-00ac-42e9-a185-b2738caddcd0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:01:19.056512 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-385ac485-00ac-42e9-a185-b2738caddcd0 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1577 microversion: 2.1 time: 0.160713 Jul 12 04:01:19.057059 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 557/1076] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:01:18 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:01:20.078337 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1bd92cf6-9146-4a1f-85d7-862a7615f47a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:20.079364 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1bd92cf6-9146-4a1f-85d7-862a7615f47a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:20.090040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1bd92cf6-9146-4a1f-85d7-862a7615f47a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:20.090526 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1bd92cf6-9146-4a1f-85d7-862a7615f47a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:20.091301 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1bd92cf6-9146-4a1f-85d7-862a7615f47a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:20.091740 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1bd92cf6-9146-4a1f-85d7-862a7615f47a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:20.233993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1bd92cf6-9146-4a1f-85d7-862a7615f47a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:01:20.241939 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1bd92cf6-9146-4a1f-85d7-862a7615f47a tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1459 microversion: 2.1 time: 0.170474 Jul 12 04:01:20.242516 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 520/1077] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:01:20 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1459 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:01:21.199177 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-bb2ec318-123e-4e24-8671-64da1b648d07 req-45f0fa55-97cd-4efc-9039-6de6cae0cc0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "235a37d4-1517-4ea0-ab89-8b63a0413983", "name": "network-vif-deleted", "tag": "a2e41b8a-4d2a-40b4-904c-82ef5d61e3b3"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:01:21.208189 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-bb2ec318-123e-4e24-8671-64da1b648d07 req-45f0fa55-97cd-4efc-9039-6de6cae0cc0c service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:21.208627 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-bb2ec318-123e-4e24-8671-64da1b648d07 req-45f0fa55-97cd-4efc-9039-6de6cae0cc0c service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:21.220878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-bb2ec318-123e-4e24-8671-64da1b648d07 req-45f0fa55-97cd-4efc-9039-6de6cae0cc0c service nova] Creating event network-vif-deleted:a2e41b8a-4d2a-40b4-904c-82ef5d61e3b3 for instance 235a37d4-1517-4ea0-ab89-8b63a0413983 on hv-cinder-84773 Jul 12 04:01:21.228308 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-bb2ec318-123e-4e24-8671-64da1b648d07 req-45f0fa55-97cd-4efc-9039-6de6cae0cc0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032267 Jul 12 04:01:21.229313 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 558/1078] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:01:21.260136 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-5399c0b8-7a9d-4170-85c4-c2af23f4ddb1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:21.260742 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-5399c0b8-7a9d-4170-85c4-c2af23f4ddb1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:21.268352 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5399c0b8-7a9d-4170-85c4-c2af23f4ddb1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:21.268795 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5399c0b8-7a9d-4170-85c4-c2af23f4ddb1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:21.269562 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5399c0b8-7a9d-4170-85c4-c2af23f4ddb1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:21.269991 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-5399c0b8-7a9d-4170-85c4-c2af23f4ddb1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:21.332836 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-5399c0b8-7a9d-4170-85c4-c2af23f4ddb1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d5c3f98d924538a34c4b3a57fcac14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d9e85c63234c77889f856bf95288f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:01:21.340603 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-5399c0b8-7a9d-4170-85c4-c2af23f4ddb1 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 200 len: 1225 microversion: 2.1 time: 0.085366 Jul 12 04:01:21.341187 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 521/1079] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:01:21 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:01:22.363365 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8d068de1-73b1-4de8-bf75-73bde4ed3414 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:22.364553 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8d068de1-73b1-4de8-bf75-73bde4ed3414 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 235a37d4-1517-4ea0-ab89-8b63a0413983] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:22.373729 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8d068de1-73b1-4de8-bf75-73bde4ed3414 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:22.374174 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8d068de1-73b1-4de8-bf75-73bde4ed3414 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:22.374926 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8d068de1-73b1-4de8-bf75-73bde4ed3414 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:22.375351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8d068de1-73b1-4de8-bf75-73bde4ed3414 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:22.388947 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-8d068de1-73b1-4de8-bf75-73bde4ed3414 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] HTTP exception thrown: Instance 235a37d4-1517-4ea0-ab89-8b63a0413983 could not be found. Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8d068de1-73b1-4de8-bf75-73bde4ed3414 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Request method failure captured: Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 HTTP/1.1 Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO-8dpqzFzcrMCwqDwKjSU2VKruOD36zfE4WUHD_UvZUXRjz_J21oJmVhAiu7kpxRHTvSZNc1KEs2RJnDGiiNwCVQTjz6Ue8nGMcLQsM6XF3zmKzP_EBrxmIwgay9qHtOmCbmvpx8bbBjSxehF3uy9s0OVGu4VRKaONcH2bTLous7NI Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 99d9e85c63234c77889f856bf95288f5 Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-TestVolumeBootPattern-1773194956 Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:01:22.390537 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:01:22.392118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99d9e85c63234c77889f856bf95288f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99d9e85c63234c77889f856bf95288f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99d9e85c63234c77889f856bf95288f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99d9e85c63234c77889f856bf95288f5"}]}] Jul 12 04:01:22.392118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-TestVolumeBootPattern-1773194956 Jul 12 04:01:22.392118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 99d9e85c63234c77889f856bf95288f5 Jul 12 04:01:22.392118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-TestVolumeBootPattern-1773194956 Jul 12 04:01:22.392118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-TestVolumeBootPattern-1773194956-project Jul 12 04:01:22.392118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:01:22.392118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:01:22.392118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 46d5c3f98d924538a34c4b3a57fcac14 Jul 12 04:01:22.392118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-TestVolumeBootPattern-1773194956-project Jul 12 04:01:22.392118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:01:22.392118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance 235a37d4-1517-4ea0-ab89-8b63a0413983 could not be found. Jul 12 04:01:22.392118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': '235a37d4-1517-4ea0-ab89-8b63a0413983'} Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 235a37d4-1517-4ea0-ab89-8b63a0413983 could not be found. Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:01:22.393025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 235a37d4-1517-4ea0-ab89-8b63a0413983 could not be found. Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 235a37d4-1517-4ea0-ab89-8b63a0413983 could not be found. Jul 12 04:01:22.394717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.396237 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8d068de1-73b1-4de8-bf75-73bde4ed3414 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Returning 404 to user: Instance 235a37d4-1517-4ea0-ab89-8b63a0413983 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:01:22.396237 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8d068de1-73b1-4de8-bf75-73bde4ed3414 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983" status: 404 len: 111 microversion: 2.1 time: 0.036537 Jul 12 04:01:22.396237 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 559/1080] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:01:22 2022] GET /compute/v2.1/servers/235a37d4-1517-4ea0-ab89-8b63a0413983 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:01:22.836371 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6e4d19c0-ab6a-44d7-b069-418dcfcb7460 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:22.836886 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6e4d19c0-ab6a-44d7-b069-418dcfcb7460 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:22.843778 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6e4d19c0-ab6a-44d7-b069-418dcfcb7460 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:22.844280 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6e4d19c0-ab6a-44d7-b069-418dcfcb7460 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:22.845043 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6e4d19c0-ab6a-44d7-b069-418dcfcb7460 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:22.845484 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6e4d19c0-ab6a-44d7-b069-418dcfcb7460 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:22.859251 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-6e4d19c0-ab6a-44d7-b069-418dcfcb7460 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] HTTP exception thrown: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6e4d19c0-ab6a-44d7-b069-418dcfcb7460 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Request method failure captured: Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: DELETE /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 HTTP/1.1 Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizO-8dpqzFzcrMCwqDwKjSU2VKruOD36zfE4WUHD_UvZUXRjz_J21oJmVhAiu7kpxRHTvSZNc1KEs2RJnDGiiNwCVQTjz6Ue8nGMcLQsM6XF3zmKzP_EBrxmIwgay9qHtOmCbmvpx8bbBjSxehF3uy9s0OVGu4VRKaONcH2bTLous7NI Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 99d9e85c63234c77889f856bf95288f5 Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-TestVolumeBootPattern-1773194956 Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:01:22.860967 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:01:22.862324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99d9e85c63234c77889f856bf95288f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99d9e85c63234c77889f856bf95288f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99d9e85c63234c77889f856bf95288f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99d9e85c63234c77889f856bf95288f5"}]}] Jul 12 04:01:22.862324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-TestVolumeBootPattern-1773194956 Jul 12 04:01:22.862324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 99d9e85c63234c77889f856bf95288f5 Jul 12 04:01:22.862324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-TestVolumeBootPattern-1773194956 Jul 12 04:01:22.862324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-TestVolumeBootPattern-1773194956-project Jul 12 04:01:22.862324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:01:22.862324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:01:22.862324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 46d5c3f98d924538a34c4b3a57fcac14 Jul 12 04:01:22.862324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-TestVolumeBootPattern-1773194956-project Jul 12 04:01:22.862324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:01:22.862324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 04:01:22.862324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': '58f988bb-503a-447f-a796-236af82ab9f6'} Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:01:22.863133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 04:01:22.864530 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.866558 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6e4d19c0-ab6a-44d7-b069-418dcfcb7460 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Returning 404 to user: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:01:22.866558 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6e4d19c0-ab6a-44d7-b069-418dcfcb7460 tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "DELETE /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 404 len: 111 microversion: 2.1 time: 0.030433 Jul 12 04:01:22.866558 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 522/1081] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:01:22 2022] DELETE /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:01:22.871430 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1e5c105e-6239-4f77-a141-5fe4bd21c97b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:22.872079 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1e5c105e-6239-4f77-a141-5fe4bd21c97b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] [instance: 58f988bb-503a-447f-a796-236af82ab9f6] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:01:22.878104 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1e5c105e-6239-4f77-a141-5fe4bd21c97b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:22.878549 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1e5c105e-6239-4f77-a141-5fe4bd21c97b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:22.879303 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1e5c105e-6239-4f77-a141-5fe4bd21c97b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:01:22.879732 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1e5c105e-6239-4f77-a141-5fe4bd21c97b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:01:22.893471 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-1e5c105e-6239-4f77-a141-5fe4bd21c97b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] HTTP exception thrown: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1e5c105e-6239-4f77-a141-5fe4bd21c97b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Request method failure captured: Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 HTTP/1.1 Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizO-8dpqzFzcrMCwqDwKjSU2VKruOD36zfE4WUHD_UvZUXRjz_J21oJmVhAiu7kpxRHTvSZNc1KEs2RJnDGiiNwCVQTjz6Ue8nGMcLQsM6XF3zmKzP_EBrxmIwgay9qHtOmCbmvpx8bbBjSxehF3uy9s0OVGu4VRKaONcH2bTLous7NI Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 99d9e85c63234c77889f856bf95288f5 Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-TestVolumeBootPattern-1773194956 Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:01:22.894993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:01:22.896670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99d9e85c63234c77889f856bf95288f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99d9e85c63234c77889f856bf95288f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99d9e85c63234c77889f856bf95288f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99d9e85c63234c77889f856bf95288f5"}]}] Jul 12 04:01:22.896670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-TestVolumeBootPattern-1773194956 Jul 12 04:01:22.896670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 99d9e85c63234c77889f856bf95288f5 Jul 12 04:01:22.896670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-TestVolumeBootPattern-1773194956 Jul 12 04:01:22.896670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-TestVolumeBootPattern-1773194956-project Jul 12 04:01:22.896670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:01:22.896670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:01:22.896670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 46d5c3f98d924538a34c4b3a57fcac14 Jul 12 04:01:22.896670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-TestVolumeBootPattern-1773194956-project Jul 12 04:01:22.896670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:01:22.896670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 04:01:22.896670 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': '58f988bb-503a-447f-a796-236af82ab9f6'} Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:01:22.897576 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. Jul 12 04:01:22.898843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:01:22.900096 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1e5c105e-6239-4f77-a141-5fe4bd21c97b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Returning 404 to user: Instance 58f988bb-503a-447f-a796-236af82ab9f6 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:01:22.900096 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1e5c105e-6239-4f77-a141-5fe4bd21c97b tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6" status: 404 len: 111 microversion: 2.1 time: 0.028955 Jul 12 04:01:22.900096 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 560/1082] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:01:22 2022] GET /compute/v2.1/servers/58f988bb-503a-447f-a796-236af82ab9f6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:01:24.208310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-642b0db4-ac0b-435c-865a-1ed63b56791d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] Calling method '.version_select at 0x7fd7fa55ba60>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:01:24.230167 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-642b0db4-ac0b-435c-865a-1ed63b56791d tempest-TestVolumeBootPattern-1773194956 tempest-TestVolumeBootPattern-1773194956-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-359074052" status: 202 len: 0 microversion: 2.1 time: 0.025670 Jul 12 04:01:24.234566 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 523/1083] 10.222.0.20 () {58 vars in 1259 bytes} [Tue Jul 12 04:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-359074052 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 04:02:28.212203 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:02:28.213377 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:02:28.218378 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-fbc1a266-fef6-4d0a-95c6-ebb437a5eb9e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:28.218935 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-fbc1a266-fef6-4d0a-95c6-ebb437a5eb9e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:28.228150 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fbc1a266-fef6-4d0a-95c6-ebb437a5eb9e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:28.228652 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fbc1a266-fef6-4d0a-95c6-ebb437a5eb9e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:28.229510 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fbc1a266-fef6-4d0a-95c6-ebb437a5eb9e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:28.229995 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fbc1a266-fef6-4d0a-95c6-ebb437a5eb9e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:28.256408 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-fbc1a266-fef6-4d0a-95c6-ebb437a5eb9e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4/ips" status: 200 len: 151 microversion: 2.1 time: 0.047483 Jul 12 04:02:28.256972 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 561/1084] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 04:02:28 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:02:29.627016 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:02:29.627798 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:02:29.632148 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0cc7038d-aee4-465f-934a-1bf91387a76d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f4bde88-44a1-4c9f-8b25-c4fb848c6be8"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:02:29.633211 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0cc7038d-aee4-465f-934a-1bf91387a76d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:29.642340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0cc7038d-aee4-465f-934a-1bf91387a76d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:29.642786 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0cc7038d-aee4-465f-934a-1bf91387a76d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:29.643591 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0cc7038d-aee4-465f-934a-1bf91387a76d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:29.644038 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0cc7038d-aee4-465f-934a-1bf91387a76d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:29.923705 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0cc7038d-aee4-465f-934a-1bf91387a76d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298287 Jul 12 04:02:29.924347 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 524/1085] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 04:02:29 2022] POST /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:02:37.306436 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:02:37.307477 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Tue Jul 12 04:02:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 04:02:37.494818 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-fec48ecb-b275-4467-a3c5-b65760d8d9fd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: .version_select at 0x7fd7fa74f040>, body: {"keypair": {"name": "tempest-keypair-815570138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFYx8iScZWT1t0eVMnAr/y/GZoo/YFkahwvdJHIr2tZ87Y/vUF35IhlyWWWFaFDLvUpnhxN9hsDS3i+NyltbrNSu+4OJtagXyhMvqMbI6jtpeloCSsO4Bxmts8q8bGgQg=="}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:02:37.510773 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-fec48ecb-b275-4467-a3c5-b65760d8d9fd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for project 5c29114118814a298f6337842ad29a9b. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 04:02:37.514700 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-fec48ecb-b275-4467-a3c5-b65760d8d9fd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for user 0995483e7e7049bbb639ef3142192abe and project 5c29114118814a298f6337842ad29a9b. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 04:02:37.527270 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fec48ecb-b275-4467-a3c5-b65760d8d9fd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [e1d8ec5c-ef15-4d23-843e-1e8b046b0ca6] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 12 04:02:38.250779 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=4 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:02:38.541809 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO oslo.messaging._drivers.impl_rabbit [None req-fec48ecb-b275-4467-a3c5-b65760d8d9fd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [e1d8ec5c-ef15-4d23-843e-1e8b046b0ca6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45964. Jul 12 04:02:38.567440 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-fec48ecb-b275-4467-a3c5-b65760d8d9fd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.076630 Jul 12 04:02:38.568071 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 562/1086] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 04:02:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:02:39.866623 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-998172236", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56d544be-a0fe-4e9c-9375-791b0f38b322"}], "security_groups": [{"name": "tempest-securitygroup--1211845023"}], "key_name": "tempest-keypair-815570138", "user_data": "}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:02:39.873752 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:02:39.913581 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:02:39.974603 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.network.neutron [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] validate_networks() for [('56d544be-a0fe-4e9c-9375-791b0f38b322', None, None, None, None, None)] {{(pid=124435) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 04:02:40.474355 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Flavor limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 04:02:40.474769 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Image limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 04:02:40.475234 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Flavor pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 04:02:40.475629 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Image pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 04:02:40.476102 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 04:02:40.485282 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:40.485723 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:40.486513 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:40.486942 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:40.504839 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for project 5c29114118814a298f6337842ad29a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 04:02:40.509281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for user 0995483e7e7049bbb639ef3142192abe and project 5c29114118814a298f6337842ad29a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 04:02:40.521063 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Going to run 1 instances... {{(pid=124435) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 04:02:40.523385 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124435) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 04:02:40.577766 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b3b6b16f-76e0-4b9b-9611-a356c83a25b2 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.715740 Jul 12 04:02:40.578443 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 525/1087] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 04:02:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 04:02:40.588888 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-9c41dc10-118f-49f8-b978-a27c811adb92 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:40.589471 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-9c41dc10-118f-49f8-b978-a27c811adb92 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:40.643194 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-9c41dc10-118f-49f8-b978-a27c811adb92 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:02:40.649883 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-9c41dc10-118f-49f8-b978-a27c811adb92 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1240 microversion: 2.1 time: 0.065339 Jul 12 04:02:40.650440 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 563/1088] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:02:40 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:02:41.672502 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-27738a30-67d8-44b3-aa47-e4e0be6a2173 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:41.673401 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-27738a30-67d8-44b3-aa47-e4e0be6a2173 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:41.684402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-27738a30-67d8-44b3-aa47-e4e0be6a2173 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:41.685155 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-27738a30-67d8-44b3-aa47-e4e0be6a2173 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:41.686422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-27738a30-67d8-44b3-aa47-e4e0be6a2173 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:41.687281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-27738a30-67d8-44b3-aa47-e4e0be6a2173 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:41.752460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-27738a30-67d8-44b3-aa47-e4e0be6a2173 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:02:41.760426 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-27738a30-67d8-44b3-aa47-e4e0be6a2173 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1292 microversion: 2.1 time: 0.095449 Jul 12 04:02:41.761281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 526/1089] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:02:41 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:02:42.779982 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-67b166cb-edfe-4bbc-84b1-47a1fea135e8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:42.781812 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-67b166cb-edfe-4bbc-84b1-47a1fea135e8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:42.788765 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-67b166cb-edfe-4bbc-84b1-47a1fea135e8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:42.789581 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-67b166cb-edfe-4bbc-84b1-47a1fea135e8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:42.790361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-67b166cb-edfe-4bbc-84b1-47a1fea135e8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:42.790789 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-67b166cb-edfe-4bbc-84b1-47a1fea135e8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:42.930878 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-67b166cb-edfe-4bbc-84b1-47a1fea135e8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:02:42.938596 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-67b166cb-edfe-4bbc-84b1-47a1fea135e8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1366 microversion: 2.1 time: 0.162641 Jul 12 04:02:42.939393 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 564/1090] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:02:42 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:02:43.345406 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-8d6ebdbf-a91a-479a-be55-473d4309f579 req-bde3d774-3792-492d-8e83-d265af84616c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b20034-9434-4ff8-b58b-1e1233ecfc8d", "tag": "37b0d75a-57a4-4b8b-8b57-226342682fd8"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:02:43.355370 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-8d6ebdbf-a91a-479a-be55-473d4309f579 req-bde3d774-3792-492d-8e83-d265af84616c service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:43.356183 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-8d6ebdbf-a91a-479a-be55-473d4309f579 req-bde3d774-3792-492d-8e83-d265af84616c service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:43.368751 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-8d6ebdbf-a91a-479a-be55-473d4309f579 req-bde3d774-3792-492d-8e83-d265af84616c service nova] Creating event network-changed:37b0d75a-57a4-4b8b-8b57-226342682fd8 for instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d on hv-cinder-84773 Jul 12 04:02:43.374221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-8d6ebdbf-a91a-479a-be55-473d4309f579 req-bde3d774-3792-492d-8e83-d265af84616c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032517 Jul 12 04:02:43.375407 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 527/1091] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:02:43.956439 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a73f4d09-66cd-4cb9-a231-62bce7a84c9b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:43.957716 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a73f4d09-66cd-4cb9-a231-62bce7a84c9b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:43.965185 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a73f4d09-66cd-4cb9-a231-62bce7a84c9b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:43.965811 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a73f4d09-66cd-4cb9-a231-62bce7a84c9b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:43.966985 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a73f4d09-66cd-4cb9-a231-62bce7a84c9b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:43.967713 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a73f4d09-66cd-4cb9-a231-62bce7a84c9b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:44.099243 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a73f4d09-66cd-4cb9-a231-62bce7a84c9b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:02:44.107119 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a73f4d09-66cd-4cb9-a231-62bce7a84c9b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1366 microversion: 2.1 time: 0.154908 Jul 12 04:02:44.107668 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 565/1092] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:02:43 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:02:45.128411 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-48b5010b-ea58-45d8-b26d-559040bc1632 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:45.129162 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-48b5010b-ea58-45d8-b26d-559040bc1632 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:45.136254 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-48b5010b-ea58-45d8-b26d-559040bc1632 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:45.136638 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-48b5010b-ea58-45d8-b26d-559040bc1632 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:45.137366 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-48b5010b-ea58-45d8-b26d-559040bc1632 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:45.137799 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-48b5010b-ea58-45d8-b26d-559040bc1632 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:45.275643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-48b5010b-ea58-45d8-b26d-559040bc1632 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:02:45.283452 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-48b5010b-ea58-45d8-b26d-559040bc1632 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1366 microversion: 2.1 time: 0.161487 Jul 12 04:02:45.284031 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 528/1093] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:02:45 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:02:46.301082 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-3b185bf5-65bc-4c51-abdf-96d5bc3c6f18 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:46.301786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-3b185bf5-65bc-4c51-abdf-96d5bc3c6f18 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:46.308601 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3b185bf5-65bc-4c51-abdf-96d5bc3c6f18 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:46.309057 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3b185bf5-65bc-4c51-abdf-96d5bc3c6f18 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:46.309829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3b185bf5-65bc-4c51-abdf-96d5bc3c6f18 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:46.310269 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3b185bf5-65bc-4c51-abdf-96d5bc3c6f18 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:46.442867 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-3b185bf5-65bc-4c51-abdf-96d5bc3c6f18 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:02:46.450490 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-3b185bf5-65bc-4c51-abdf-96d5bc3c6f18 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1366 microversion: 2.1 time: 0.153426 Jul 12 04:02:46.451057 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 566/1094] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:02:46 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:02:47.469402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f8ef85a4-5783-4f8c-a343-41bdaee5bdfd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:47.470109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f8ef85a4-5783-4f8c-a343-41bdaee5bdfd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:47.477187 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f8ef85a4-5783-4f8c-a343-41bdaee5bdfd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:47.477903 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f8ef85a4-5783-4f8c-a343-41bdaee5bdfd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:47.478675 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f8ef85a4-5783-4f8c-a343-41bdaee5bdfd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:47.479114 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f8ef85a4-5783-4f8c-a343-41bdaee5bdfd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:47.614144 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f8ef85a4-5783-4f8c-a343-41bdaee5bdfd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:02:47.623188 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f8ef85a4-5783-4f8c-a343-41bdaee5bdfd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1366 microversion: 2.1 time: 0.157376 Jul 12 04:02:47.624053 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 529/1095] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:02:47 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:02:48.644343 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1b1faad0-cc5d-4893-94e6-0b2face3b99d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:48.644988 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1b1faad0-cc5d-4893-94e6-0b2face3b99d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:48.652534 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1b1faad0-cc5d-4893-94e6-0b2face3b99d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:48.653037 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1b1faad0-cc5d-4893-94e6-0b2face3b99d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:48.653937 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1b1faad0-cc5d-4893-94e6-0b2face3b99d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:48.654422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1b1faad0-cc5d-4893-94e6-0b2face3b99d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:48.787460 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-1b1faad0-cc5d-4893-94e6-0b2face3b99d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:02:48.795555 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1b1faad0-cc5d-4893-94e6-0b2face3b99d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1366 microversion: 2.1 time: 0.156811 Jul 12 04:02:48.796154 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 567/1096] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:02:48 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:02:49.573535 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-24cf09c1-0f6f-4aaa-98ab-585160300276 req-607be0d2-1a4b-4eae-9c7e-1afe839d34c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b20034-9434-4ff8-b58b-1e1233ecfc8d", "name": "network-vif-plugged", "status": "completed", "tag": "37b0d75a-57a4-4b8b-8b57-226342682fd8"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:02:49.582592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-24cf09c1-0f6f-4aaa-98ab-585160300276 req-607be0d2-1a4b-4eae-9c7e-1afe839d34c6 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:49.583040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-24cf09c1-0f6f-4aaa-98ab-585160300276 req-607be0d2-1a4b-4eae-9c7e-1afe839d34c6 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:49.595102 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-24cf09c1-0f6f-4aaa-98ab-585160300276 req-607be0d2-1a4b-4eae-9c7e-1afe839d34c6 service nova] Creating event network-vif-plugged:37b0d75a-57a4-4b8b-8b57-226342682fd8 for instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d on hv-cinder-84773 Jul 12 04:02:49.600726 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-24cf09c1-0f6f-4aaa-98ab-585160300276 req-607be0d2-1a4b-4eae-9c7e-1afe839d34c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157693 Jul 12 04:02:49.601824 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 530/1097] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:02:49.812924 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0584cafd-598f-43be-bdd1-f95e8ee5779a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:49.813688 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0584cafd-598f-43be-bdd1-f95e8ee5779a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:49.822414 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0584cafd-598f-43be-bdd1-f95e8ee5779a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:49.822868 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0584cafd-598f-43be-bdd1-f95e8ee5779a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:49.823752 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0584cafd-598f-43be-bdd1-f95e8ee5779a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:49.824238 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0584cafd-598f-43be-bdd1-f95e8ee5779a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:49.966958 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0584cafd-598f-43be-bdd1-f95e8ee5779a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:02:49.976250 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0584cafd-598f-43be-bdd1-f95e8ee5779a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1366 microversion: 2.1 time: 0.167234 Jul 12 04:02:49.976828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 568/1098] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:02:49 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:02:50.991141 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:02:50.991932 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=6 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:02:50.996386 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3da3fcec-8163-4911-9b2f-ef55410251f8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:50.997110 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3da3fcec-8163-4911-9b2f-ef55410251f8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:51.004431 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3da3fcec-8163-4911-9b2f-ef55410251f8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:51.004879 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3da3fcec-8163-4911-9b2f-ef55410251f8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:51.005645 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3da3fcec-8163-4911-9b2f-ef55410251f8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:51.006072 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3da3fcec-8163-4911-9b2f-ef55410251f8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:51.142248 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-3da3fcec-8163-4911-9b2f-ef55410251f8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:02:51.150073 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3da3fcec-8163-4911-9b2f-ef55410251f8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1366 microversion: 2.1 time: 0.160406 Jul 12 04:02:51.150643 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 531/1099] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:02:50 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:02:52.171361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-fe9e8293-290b-4d8b-a1ec-91470801b58f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:52.172453 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-fe9e8293-290b-4d8b-a1ec-91470801b58f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:52.175331 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=6 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:02:52.185009 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fe9e8293-290b-4d8b-a1ec-91470801b58f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:52.185741 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fe9e8293-290b-4d8b-a1ec-91470801b58f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:52.187033 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fe9e8293-290b-4d8b-a1ec-91470801b58f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:52.187748 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fe9e8293-290b-4d8b-a1ec-91470801b58f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:52.325210 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-fe9e8293-290b-4d8b-a1ec-91470801b58f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:02:52.332903 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-fe9e8293-290b-4d8b-a1ec-91470801b58f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1556 microversion: 2.1 time: 0.168434 Jul 12 04:02:52.333464 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 569/1100] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:02:52 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:02:52.349277 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7c10eb0e-acf2-4da8-83c9-7fd3d80a6c92 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:02:52.349804 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7c10eb0e-acf2-4da8-83c9-7fd3d80a6c92 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:02:52.356422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c10eb0e-acf2-4da8-83c9-7fd3d80a6c92 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:52.356863 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c10eb0e-acf2-4da8-83c9-7fd3d80a6c92 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:52.357611 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c10eb0e-acf2-4da8-83c9-7fd3d80a6c92 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:52.358037 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c10eb0e-acf2-4da8-83c9-7fd3d80a6c92 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:52.436948 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7c10eb0e-acf2-4da8-83c9-7fd3d80a6c92 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091070 Jul 12 04:02:52.437707 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 532/1101] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 04:02:52 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 04:02:53.697314 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-7245af32-f29c-44ba-a299-1900f049bd41 req-ef579e7e-04ab-44f2-90dd-666ddf345679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b20034-9434-4ff8-b58b-1e1233ecfc8d", "tag": "37b0d75a-57a4-4b8b-8b57-226342682fd8"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:02:53.707139 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-7245af32-f29c-44ba-a299-1900f049bd41 req-ef579e7e-04ab-44f2-90dd-666ddf345679 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:02:53.707679 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-7245af32-f29c-44ba-a299-1900f049bd41 req-ef579e7e-04ab-44f2-90dd-666ddf345679 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:02:53.728584 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-7245af32-f29c-44ba-a299-1900f049bd41 req-ef579e7e-04ab-44f2-90dd-666ddf345679 service nova] Creating event network-changed:37b0d75a-57a4-4b8b-8b57-226342682fd8 for instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d on hv-cinder-84773 Jul 12 04:02:53.733886 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-7245af32-f29c-44ba-a299-1900f049bd41 req-ef579e7e-04ab-44f2-90dd-666ddf345679 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040323 Jul 12 04:02:53.734509 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 570/1102] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:03:11.401453 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:03:11.402691 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=34 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:03:11.410282 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-bac0081e-e885-4cac-a6f8-015d5070a8d1 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:03:11.410813 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-bac0081e-e885-4cac-a6f8-015d5070a8d1 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:11.419177 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bac0081e-e885-4cac-a6f8-015d5070a8d1 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:11.419631 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bac0081e-e885-4cac-a6f8-015d5070a8d1 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:11.420421 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bac0081e-e885-4cac-a6f8-015d5070a8d1 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:11.420855 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-bac0081e-e885-4cac-a6f8-015d5070a8d1 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:11.443634 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.objects.instance [None req-bac0081e-e885-4cac-a6f8-015d5070a8d1 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lazy-loading 'flavor' on Instance uuid 1b74d356-e773-4d8b-85cf-b31c80c2aef3 {{(pid=124435) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 04:03:11.518766 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-bac0081e-e885-4cac-a6f8-015d5070a8d1 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "POST /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3/action" status: 202 len: 0 microversion: 2.1 time: 0.119226 Jul 12 04:03:11.519513 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 533/1103] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 04:03:11 2022] POST /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 04:03:11.526221 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:03:11.526971 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=38 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:03:11.531033 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6f2396c7-c5d6-46eb-a4c1-0d4677c1eb5f tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:11.531747 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-6f2396c7-c5d6-46eb-a4c1-0d4677c1eb5f tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:11.539358 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6f2396c7-c5d6-46eb-a4c1-0d4677c1eb5f tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:11.539801 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6f2396c7-c5d6-46eb-a4c1-0d4677c1eb5f tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:11.540942 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6f2396c7-c5d6-46eb-a4c1-0d4677c1eb5f tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:11.541378 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-6f2396c7-c5d6-46eb-a4c1-0d4677c1eb5f tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:11.675225 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-6f2396c7-c5d6-46eb-a4c1-0d4677c1eb5f tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:11.683140 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-6f2396c7-c5d6-46eb-a4c1-0d4677c1eb5f tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.158526 Jul 12 04:03:11.683705 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 571/1104] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:11 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:12.706117 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0c03d82e-4847-472a-bb8b-21e367c92e69 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:12.707358 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0c03d82e-4847-472a-bb8b-21e367c92e69 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:12.714218 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0c03d82e-4847-472a-bb8b-21e367c92e69 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:12.714671 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0c03d82e-4847-472a-bb8b-21e367c92e69 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:12.715435 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0c03d82e-4847-472a-bb8b-21e367c92e69 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:12.715869 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0c03d82e-4847-472a-bb8b-21e367c92e69 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:12.856281 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-0c03d82e-4847-472a-bb8b-21e367c92e69 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:12.867798 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0c03d82e-4847-472a-bb8b-21e367c92e69 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.169603 Jul 12 04:03:12.868601 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 534/1105] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:12 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:13.892639 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c879b5e7-62ac-42f9-875b-7ec9ce963f5a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:13.893624 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c879b5e7-62ac-42f9-875b-7ec9ce963f5a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:13.905179 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c879b5e7-62ac-42f9-875b-7ec9ce963f5a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:13.905909 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c879b5e7-62ac-42f9-875b-7ec9ce963f5a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:13.907149 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c879b5e7-62ac-42f9-875b-7ec9ce963f5a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:13.907865 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c879b5e7-62ac-42f9-875b-7ec9ce963f5a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:14.050961 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c879b5e7-62ac-42f9-875b-7ec9ce963f5a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:14.058754 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c879b5e7-62ac-42f9-875b-7ec9ce963f5a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.172697 Jul 12 04:03:14.059337 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 572/1106] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:13 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:15.081847 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ff92920b-5f55-442d-8028-ca2461878012 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:15.082495 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ff92920b-5f55-442d-8028-ca2461878012 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:15.090906 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ff92920b-5f55-442d-8028-ca2461878012 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:15.091425 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ff92920b-5f55-442d-8028-ca2461878012 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:15.092455 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ff92920b-5f55-442d-8028-ca2461878012 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:15.092968 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ff92920b-5f55-442d-8028-ca2461878012 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:15.252543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ff92920b-5f55-442d-8028-ca2461878012 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:15.260442 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ff92920b-5f55-442d-8028-ca2461878012 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.185127 Jul 12 04:03:15.261017 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 535/1107] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:15 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:16.281889 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-31a2bbdb-adf8-488b-8ce8-2eebc974ef35 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:16.282752 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-31a2bbdb-adf8-488b-8ce8-2eebc974ef35 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:16.294059 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-31a2bbdb-adf8-488b-8ce8-2eebc974ef35 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:16.294793 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-31a2bbdb-adf8-488b-8ce8-2eebc974ef35 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:16.296086 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-31a2bbdb-adf8-488b-8ce8-2eebc974ef35 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:16.296800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-31a2bbdb-adf8-488b-8ce8-2eebc974ef35 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:16.431351 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-31a2bbdb-adf8-488b-8ce8-2eebc974ef35 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:16.443123 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-31a2bbdb-adf8-488b-8ce8-2eebc974ef35 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.167597 Jul 12 04:03:16.443888 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 573/1108] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:16 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:17.469979 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-90f422e7-5fc0-479b-9fd8-e1269a9b8acc tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:17.470956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-90f422e7-5fc0-479b-9fd8-e1269a9b8acc tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:17.478853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-90f422e7-5fc0-479b-9fd8-e1269a9b8acc tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:17.479325 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-90f422e7-5fc0-479b-9fd8-e1269a9b8acc tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:17.480169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-90f422e7-5fc0-479b-9fd8-e1269a9b8acc tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:17.480629 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-90f422e7-5fc0-479b-9fd8-e1269a9b8acc tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:17.620214 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-90f422e7-5fc0-479b-9fd8-e1269a9b8acc tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:17.628513 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-90f422e7-5fc0-479b-9fd8-e1269a9b8acc tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.165023 Jul 12 04:03:17.629178 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 536/1109] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:17 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:18.650607 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-697ff761-f59d-4392-8ad9-83b4827376f3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:18.651550 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-697ff761-f59d-4392-8ad9-83b4827376f3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:18.662154 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-697ff761-f59d-4392-8ad9-83b4827376f3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:18.662954 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-697ff761-f59d-4392-8ad9-83b4827376f3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:18.664261 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-697ff761-f59d-4392-8ad9-83b4827376f3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:18.665185 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-697ff761-f59d-4392-8ad9-83b4827376f3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:18.826541 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-697ff761-f59d-4392-8ad9-83b4827376f3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:18.834981 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-697ff761-f59d-4392-8ad9-83b4827376f3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.191326 Jul 12 04:03:18.835556 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 574/1110] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:18 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:19.856543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-76c8ab28-667c-4eef-b37f-7664b1774866 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:19.857597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-76c8ab28-667c-4eef-b37f-7664b1774866 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:19.868706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-76c8ab28-667c-4eef-b37f-7664b1774866 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:19.869453 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-76c8ab28-667c-4eef-b37f-7664b1774866 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:19.870733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-76c8ab28-667c-4eef-b37f-7664b1774866 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:19.871460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-76c8ab28-667c-4eef-b37f-7664b1774866 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:20.021427 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-76c8ab28-667c-4eef-b37f-7664b1774866 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:20.029389 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-76c8ab28-667c-4eef-b37f-7664b1774866 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.179385 Jul 12 04:03:20.029933 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 537/1111] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:19 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:21.051373 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-fb7e0138-a8f8-40cf-b3b3-56f9050d5055 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:21.052462 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-fb7e0138-a8f8-40cf-b3b3-56f9050d5055 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:21.063531 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb7e0138-a8f8-40cf-b3b3-56f9050d5055 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:21.064361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb7e0138-a8f8-40cf-b3b3-56f9050d5055 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:21.065679 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb7e0138-a8f8-40cf-b3b3-56f9050d5055 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:21.066406 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-fb7e0138-a8f8-40cf-b3b3-56f9050d5055 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:21.209903 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-fb7e0138-a8f8-40cf-b3b3-56f9050d5055 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:21.218133 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-fb7e0138-a8f8-40cf-b3b3-56f9050d5055 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.173284 Jul 12 04:03:21.218650 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 575/1112] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:21 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:22.235305 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-890ddb96-9548-44bc-8ef3-ee00be026d21 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:22.235892 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-890ddb96-9548-44bc-8ef3-ee00be026d21 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:22.242494 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-890ddb96-9548-44bc-8ef3-ee00be026d21 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:22.242935 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-890ddb96-9548-44bc-8ef3-ee00be026d21 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:22.243701 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-890ddb96-9548-44bc-8ef3-ee00be026d21 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:22.244156 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-890ddb96-9548-44bc-8ef3-ee00be026d21 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:22.398790 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-890ddb96-9548-44bc-8ef3-ee00be026d21 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:22.406705 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-890ddb96-9548-44bc-8ef3-ee00be026d21 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.175800 Jul 12 04:03:22.407282 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 538/1113] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:22 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:23.427480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-66ab1717-fa11-4e0a-967e-8befa9ea2061 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:23.428512 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-66ab1717-fa11-4e0a-967e-8befa9ea2061 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:23.436738 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66ab1717-fa11-4e0a-967e-8befa9ea2061 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:23.437213 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66ab1717-fa11-4e0a-967e-8befa9ea2061 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:23.438025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66ab1717-fa11-4e0a-967e-8befa9ea2061 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:23.438481 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66ab1717-fa11-4e0a-967e-8befa9ea2061 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:23.577520 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-66ab1717-fa11-4e0a-967e-8befa9ea2061 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:23.589515 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-66ab1717-fa11-4e0a-967e-8befa9ea2061 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.167170 Jul 12 04:03:23.590314 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 576/1114] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:23 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:24.607934 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-b99cf7c8-b92a-4578-9f19-4e831af35752 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:24.608560 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-b99cf7c8-b92a-4578-9f19-4e831af35752 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:24.615685 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b99cf7c8-b92a-4578-9f19-4e831af35752 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:24.616340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b99cf7c8-b92a-4578-9f19-4e831af35752 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:24.616903 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b99cf7c8-b92a-4578-9f19-4e831af35752 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:24.617333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-b99cf7c8-b92a-4578-9f19-4e831af35752 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:24.752225 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-b99cf7c8-b92a-4578-9f19-4e831af35752 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:24.761133 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-b99cf7c8-b92a-4578-9f19-4e831af35752 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.158095 Jul 12 04:03:24.761882 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 539/1115] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:24 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:25.781993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-584d6177-338c-4f1d-9054-8a59b0e6693b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:25.783056 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-584d6177-338c-4f1d-9054-8a59b0e6693b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:25.792515 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-584d6177-338c-4f1d-9054-8a59b0e6693b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:25.792966 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-584d6177-338c-4f1d-9054-8a59b0e6693b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:25.793711 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-584d6177-338c-4f1d-9054-8a59b0e6693b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:25.794137 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-584d6177-338c-4f1d-9054-8a59b0e6693b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:25.938115 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-584d6177-338c-4f1d-9054-8a59b0e6693b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:25.946613 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-584d6177-338c-4f1d-9054-8a59b0e6693b tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1510 microversion: 2.1 time: 0.170904 Jul 12 04:03:25.947424 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 577/1116] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:25 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:25.967094 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-733b95b1-8480-4d36-9958-53d37beea405 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:03:25.967781 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-733b95b1-8480-4d36-9958-53d37beea405 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:25.974402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-733b95b1-8480-4d36-9958-53d37beea405 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:25.974853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-733b95b1-8480-4d36-9958-53d37beea405 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:25.975619 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-733b95b1-8480-4d36-9958-53d37beea405 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:25.976034 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-733b95b1-8480-4d36-9958-53d37beea405 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:26.055161 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-733b95b1-8480-4d36-9958-53d37beea405 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "POST /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3/action" status: 202 len: 0 microversion: 2.1 time: 0.092113 Jul 12 04:03:26.055687 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 540/1117] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 12 04:03:25 2022] POST /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 04:03:26.064174 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ed11f656-8b63-4d6c-b08d-d9e50c3ed933 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:26.064792 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ed11f656-8b63-4d6c-b08d-d9e50c3ed933 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:26.071925 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ed11f656-8b63-4d6c-b08d-d9e50c3ed933 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:26.072549 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ed11f656-8b63-4d6c-b08d-d9e50c3ed933 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:26.073485 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ed11f656-8b63-4d6c-b08d-d9e50c3ed933 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:26.074204 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ed11f656-8b63-4d6c-b08d-d9e50c3ed933 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:26.240319 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ed11f656-8b63-4d6c-b08d-d9e50c3ed933 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:26.248390 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ed11f656-8b63-4d6c-b08d-d9e50c3ed933 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1518 microversion: 2.1 time: 0.188409 Jul 12 04:03:26.248995 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 578/1118] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:26 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1518 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:27.265978 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-921c3bfa-16c2-435b-aed1-e74847c27590 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:27.266554 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-921c3bfa-16c2-435b-aed1-e74847c27590 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:27.272965 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-921c3bfa-16c2-435b-aed1-e74847c27590 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:27.273417 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-921c3bfa-16c2-435b-aed1-e74847c27590 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:27.274192 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-921c3bfa-16c2-435b-aed1-e74847c27590 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:27.274629 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-921c3bfa-16c2-435b-aed1-e74847c27590 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:27.442747 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-921c3bfa-16c2-435b-aed1-e74847c27590 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:27.450547 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-921c3bfa-16c2-435b-aed1-e74847c27590 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1520 microversion: 2.1 time: 0.189408 Jul 12 04:03:27.451126 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 541/1119] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:27 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:27.574830 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-1df77c0d-4e6a-4df6-a41b-a652199c0033 req-9bfb79e1-f85d-40c2-976c-687014bea70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b74d356-e773-4d8b-85cf-b31c80c2aef3", "name": "network-vif-unplugged", "status": "completed", "tag": "c31ca6c3-cf04-4828-a8bf-1c95239cd2d1"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:03:27.585801 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-1df77c0d-4e6a-4df6-a41b-a652199c0033 req-9bfb79e1-f85d-40c2-976c-687014bea70c service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:27.586292 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-1df77c0d-4e6a-4df6-a41b-a652199c0033 req-9bfb79e1-f85d-40c2-976c-687014bea70c service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:27.599564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.compute.server_external_events [req-1df77c0d-4e6a-4df6-a41b-a652199c0033 req-9bfb79e1-f85d-40c2-976c-687014bea70c service nova] Unable to find a host for instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3. Dropping event network-vif-unplugged {{(pid=124434) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 04:03:27.600762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-1df77c0d-4e6a-4df6-a41b-a652199c0033 req-9bfb79e1-f85d-40c2-976c-687014bea70c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030840 Jul 12 04:03:27.601780 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 579/1120] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 04:03:28.467309 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7bdc4bf3-ced4-4315-9f2c-1476f5afccfa tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:28.467975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7bdc4bf3-ced4-4315-9f2c-1476f5afccfa tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:28.475520 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7bdc4bf3-ced4-4315-9f2c-1476f5afccfa tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:28.475974 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7bdc4bf3-ced4-4315-9f2c-1476f5afccfa tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:28.476793 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7bdc4bf3-ced4-4315-9f2c-1476f5afccfa tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:28.477235 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7bdc4bf3-ced4-4315-9f2c-1476f5afccfa tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:28.686041 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-7bdc4bf3-ced4-4315-9f2c-1476f5afccfa tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:28.694062 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7bdc4bf3-ced4-4315-9f2c-1476f5afccfa tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1576 microversion: 2.1 time: 0.230652 Jul 12 04:03:28.694648 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 542/1121] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:28 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:29.717448 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e40b5aee-3560-4738-84e3-19bfaf758464 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:29.718519 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e40b5aee-3560-4738-84e3-19bfaf758464 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:29.726402 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e40b5aee-3560-4738-84e3-19bfaf758464 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:29.726857 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e40b5aee-3560-4738-84e3-19bfaf758464 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:29.727683 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e40b5aee-3560-4738-84e3-19bfaf758464 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:29.728159 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e40b5aee-3560-4738-84e3-19bfaf758464 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:29.872225 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e40b5aee-3560-4738-84e3-19bfaf758464 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:29.884289 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e40b5aee-3560-4738-84e3-19bfaf758464 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1576 microversion: 2.1 time: 0.174187 Jul 12 04:03:29.885155 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 580/1122] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:29 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:30.909937 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-59a9b4f5-4f8d-4300-92c7-d95cc33d6cb3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:30.910573 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-59a9b4f5-4f8d-4300-92c7-d95cc33d6cb3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:30.919979 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-59a9b4f5-4f8d-4300-92c7-d95cc33d6cb3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:30.920460 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-59a9b4f5-4f8d-4300-92c7-d95cc33d6cb3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:30.921223 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-59a9b4f5-4f8d-4300-92c7-d95cc33d6cb3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:30.921656 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-59a9b4f5-4f8d-4300-92c7-d95cc33d6cb3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:31.058222 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-59a9b4f5-4f8d-4300-92c7-d95cc33d6cb3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:31.065982 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-59a9b4f5-4f8d-4300-92c7-d95cc33d6cb3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1576 microversion: 2.1 time: 0.161902 Jul 12 04:03:31.066561 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 543/1123] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:30 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:32.088233 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-66e7815b-dee9-4cbb-a99a-56f4abef67c8 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:32.089176 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-66e7815b-dee9-4cbb-a99a-56f4abef67c8 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:32.096309 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66e7815b-dee9-4cbb-a99a-56f4abef67c8 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:32.096765 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66e7815b-dee9-4cbb-a99a-56f4abef67c8 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:32.097526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66e7815b-dee9-4cbb-a99a-56f4abef67c8 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:32.098012 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66e7815b-dee9-4cbb-a99a-56f4abef67c8 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:32.246146 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-66e7815b-dee9-4cbb-a99a-56f4abef67c8 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:32.258099 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-66e7815b-dee9-4cbb-a99a-56f4abef67c8 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1576 microversion: 2.1 time: 0.176361 Jul 12 04:03:32.258873 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 581/1124] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:32 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:33.280868 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6c5199d8-0ca8-47f1-8e2e-fc4470ad3371 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:33.281512 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-6c5199d8-0ca8-47f1-8e2e-fc4470ad3371 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:33.289170 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6c5199d8-0ca8-47f1-8e2e-fc4470ad3371 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:33.289695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6c5199d8-0ca8-47f1-8e2e-fc4470ad3371 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:33.290593 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6c5199d8-0ca8-47f1-8e2e-fc4470ad3371 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:33.291104 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-6c5199d8-0ca8-47f1-8e2e-fc4470ad3371 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:33.440419 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-6c5199d8-0ca8-47f1-8e2e-fc4470ad3371 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:33.452829 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6c5199d8-0ca8-47f1-8e2e-fc4470ad3371 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1576 microversion: 2.1 time: 0.178679 Jul 12 04:03:33.453597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 544/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:33 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:34.474628 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c59194d8-62d8-478f-b4c5-b41032b2d8cd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:34.475615 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c59194d8-62d8-478f-b4c5-b41032b2d8cd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:34.485708 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c59194d8-62d8-478f-b4c5-b41032b2d8cd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:34.486167 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c59194d8-62d8-478f-b4c5-b41032b2d8cd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:34.486935 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c59194d8-62d8-478f-b4c5-b41032b2d8cd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:34.487373 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c59194d8-62d8-478f-b4c5-b41032b2d8cd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:34.627076 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-c59194d8-62d8-478f-b4c5-b41032b2d8cd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:34.635054 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c59194d8-62d8-478f-b4c5-b41032b2d8cd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1576 microversion: 2.1 time: 0.167102 Jul 12 04:03:34.635635 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 582/1126] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:34 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:35.655939 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8c762fb5-df1b-4bd8-9899-89dff23a2e1c tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:35.656931 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8c762fb5-df1b-4bd8-9899-89dff23a2e1c tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:35.664030 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8c762fb5-df1b-4bd8-9899-89dff23a2e1c tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:35.664493 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8c762fb5-df1b-4bd8-9899-89dff23a2e1c tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:35.665272 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8c762fb5-df1b-4bd8-9899-89dff23a2e1c tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:35.665709 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8c762fb5-df1b-4bd8-9899-89dff23a2e1c tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:35.806624 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8c762fb5-df1b-4bd8-9899-89dff23a2e1c tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:35.818923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8c762fb5-df1b-4bd8-9899-89dff23a2e1c tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1576 microversion: 2.1 time: 0.168074 Jul 12 04:03:35.819761 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 545/1127] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:35 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:36.844541 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-339570fd-7f5c-4092-8cfa-190bf21bcdbd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:36.845503 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-339570fd-7f5c-4092-8cfa-190bf21bcdbd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:36.852520 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-339570fd-7f5c-4092-8cfa-190bf21bcdbd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:36.852975 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-339570fd-7f5c-4092-8cfa-190bf21bcdbd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:36.853742 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-339570fd-7f5c-4092-8cfa-190bf21bcdbd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:36.854178 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-339570fd-7f5c-4092-8cfa-190bf21bcdbd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:36.998653 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-339570fd-7f5c-4092-8cfa-190bf21bcdbd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:37.010327 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-339570fd-7f5c-4092-8cfa-190bf21bcdbd tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1576 microversion: 2.1 time: 0.172079 Jul 12 04:03:37.011082 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 583/1128] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:36 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:38.034526 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8d5eabfc-19b5-4d77-ab61-37ac41fbe7b3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:38.035385 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8d5eabfc-19b5-4d77-ab61-37ac41fbe7b3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:38.042632 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d5eabfc-19b5-4d77-ab61-37ac41fbe7b3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:38.043076 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d5eabfc-19b5-4d77-ab61-37ac41fbe7b3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:38.043833 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d5eabfc-19b5-4d77-ab61-37ac41fbe7b3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:38.044286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d5eabfc-19b5-4d77-ab61-37ac41fbe7b3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:38.063268 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:03:38.180328 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-8d5eabfc-19b5-4d77-ab61-37ac41fbe7b3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:38.188337 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8d5eabfc-19b5-4d77-ab61-37ac41fbe7b3 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1576 microversion: 2.1 time: 0.160444 Jul 12 04:03:38.188946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 546/1129] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:38 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:39.205325 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e73eeb89-cabf-4c0a-8cde-2fcc2d7c9273 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:39.206029 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-e73eeb89-cabf-4c0a-8cde-2fcc2d7c9273 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:39.213070 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e73eeb89-cabf-4c0a-8cde-2fcc2d7c9273 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:39.213515 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e73eeb89-cabf-4c0a-8cde-2fcc2d7c9273 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:39.214275 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e73eeb89-cabf-4c0a-8cde-2fcc2d7c9273 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:39.214703 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-e73eeb89-cabf-4c0a-8cde-2fcc2d7c9273 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:39.353967 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-e73eeb89-cabf-4c0a-8cde-2fcc2d7c9273 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:39.363615 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e73eeb89-cabf-4c0a-8cde-2fcc2d7c9273 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1576 microversion: 2.1 time: 0.162090 Jul 12 04:03:39.364231 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 584/1130] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:39 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:39.669557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-ee2b42d9-747f-43fd-ae24-d351518e43a9 req-0d23443c-4c71-4482-96d2-e0d71cf244d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b74d356-e773-4d8b-85cf-b31c80c2aef3", "name": "network-vif-plugged", "status": "completed", "tag": "c31ca6c3-cf04-4828-a8bf-1c95239cd2d1"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:03:39.681049 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-ee2b42d9-747f-43fd-ae24-d351518e43a9 req-0d23443c-4c71-4482-96d2-e0d71cf244d4 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:39.681840 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-ee2b42d9-747f-43fd-ae24-d351518e43a9 req-0d23443c-4c71-4482-96d2-e0d71cf244d4 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:39.693611 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-ee2b42d9-747f-43fd-ae24-d351518e43a9 req-0d23443c-4c71-4482-96d2-e0d71cf244d4 service nova] Creating event network-vif-plugged:c31ca6c3-cf04-4828-a8bf-1c95239cd2d1 for instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3 on hv-cinder-84773 Jul 12 04:03:39.698881 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-ee2b42d9-747f-43fd-ae24-d351518e43a9 req-0d23443c-4c71-4482-96d2-e0d71cf244d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033667 Jul 12 04:03:39.699483 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 547/1131] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:03:40.386893 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-a4c6521a-5e7e-47a8-938c-87e46c927233 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:40.387909 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-a4c6521a-5e7e-47a8-938c-87e46c927233 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:40.399004 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a4c6521a-5e7e-47a8-938c-87e46c927233 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:40.399777 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a4c6521a-5e7e-47a8-938c-87e46c927233 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:40.401109 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a4c6521a-5e7e-47a8-938c-87e46c927233 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:40.401828 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-a4c6521a-5e7e-47a8-938c-87e46c927233 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:40.548263 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-a4c6521a-5e7e-47a8-938c-87e46c927233 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:40.559298 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-a4c6521a-5e7e-47a8-938c-87e46c927233 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1576 microversion: 2.1 time: 0.179117 Jul 12 04:03:40.560065 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 585/1132] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:40 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:03:41.583509 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ab209bc4-ae55-478a-bdcb-882714e3ce6e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:03:41.584233 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ab209bc4-ae55-478a-bdcb-882714e3ce6e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:03:41.586743 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=33 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:03:41.593022 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ab209bc4-ae55-478a-bdcb-882714e3ce6e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:41.593465 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ab209bc4-ae55-478a-bdcb-882714e3ce6e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:41.594240 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ab209bc4-ae55-478a-bdcb-882714e3ce6e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:03:41.594680 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ab209bc4-ae55-478a-bdcb-882714e3ce6e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:03:41.735137 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-ab209bc4-ae55-478a-bdcb-882714e3ce6e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:03:41.742912 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ab209bc4-ae55-478a-bdcb-882714e3ce6e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1563 microversion: 2.1 time: 0.166124 Jul 12 04:03:41.743480 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 548/1133] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:03:41 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:08.846310 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-df798448-30d9-4560-b930-eaf78dd5f08e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:08.847118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-df798448-30d9-4560-b930-eaf78dd5f08e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:08.850649 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=30 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:04:08.851705 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=86 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:04:08.858164 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-df798448-30d9-4560-b930-eaf78dd5f08e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:08.858608 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-df798448-30d9-4560-b930-eaf78dd5f08e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:08.859361 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-df798448-30d9-4560-b930-eaf78dd5f08e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:08.859786 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-df798448-30d9-4560-b930-eaf78dd5f08e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:08.882446 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-df798448-30d9-4560-b930-eaf78dd5f08e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d/ips" status: 200 len: 150 microversion: 2.1 time: 0.042644 Jul 12 04:04:08.883003 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 586/1134] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 04:04:08 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:04:08.894099 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2654ddbc-5d8d-4d47-a45e-f8efee08c2f4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f4bde88-44a1-4c9f-8b25-c4fb848c6be8"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:04:08.895289 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-2654ddbc-5d8d-4d47-a45e-f8efee08c2f4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:08.897371 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:04:08.898057 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=10 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:04:08.904387 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2654ddbc-5d8d-4d47-a45e-f8efee08c2f4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:08.904839 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2654ddbc-5d8d-4d47-a45e-f8efee08c2f4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:08.905612 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2654ddbc-5d8d-4d47-a45e-f8efee08c2f4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:08.906047 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2654ddbc-5d8d-4d47-a45e-f8efee08c2f4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:08.992950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-2654ddbc-5d8d-4d47-a45e-f8efee08c2f4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Invalid volume: volume 6f4bde88-44a1-4c9f-8b25-c4fb848c6be8 is already attached to instances: a87f737c-428c-4c33-9622-1cb03773adf4 Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2654ddbc-5d8d-4d47-a45e-f8efee08c2f4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: POST /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d/os-volume_attachments HTTP/1.1 Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 74 Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:04:08.994696 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:04:08.996555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:04:08.996555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:04:08.996555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:04:08.996555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:04:08.996555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:04:08.996555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:04:08.996555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:04:08.996555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:04:08.996555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:04:08.996555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Jul 12 04:04:08.996555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {"volumeAttachment": {"volumeId": "6f4bde88-44a1-4c9f-8b25-c4fb848c6be8"}} Jul 12 04:04:08.996555 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Invalid volume: volume 6f4bde88-44a1-4c9f-8b25-c4fb848c6be8 is already attached to instances: a87f737c-428c-4c33-9622-1cb03773adf4 Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'server_id': 'c4b20034-9434-4ff8-b58b-1e1233ecfc8d', 'body': {'volumeAttachment': {'volumeId': '6f4bde88-44a1-4c9f-8b25-c4fb848c6be8'}}} Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6f4bde88-44a1-4c9f-8b25-c4fb848c6be8 is already attached to instances: a87f737c-428c-4c33-9622-1cb03773adf4 Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:08.997600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6f4bde88-44a1-4c9f-8b25-c4fb848c6be8 is already attached to instances: a87f737c-428c-4c33-9622-1cb03773adf4 Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:04:08.999304 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:04:09.001154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:04:09.001154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:04:09.001154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:04:09.001154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6f4bde88-44a1-4c9f-8b25-c4fb848c6be8 is already attached to instances: a87f737c-428c-4c33-9622-1cb03773adf4 Jul 12 04:04:09.001154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:09.001154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2654ddbc-5d8d-4d47-a45e-f8efee08c2f4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 400 to user: Invalid volume: volume 6f4bde88-44a1-4c9f-8b25-c4fb848c6be8 is already attached to instances: a87f737c-428c-4c33-9622-1cb03773adf4 {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:04:09.001154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-2654ddbc-5d8d-4d47-a45e-f8efee08c2f4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106481 Jul 12 04:04:09.001154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 549/1135] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 04:04:08 2022] POST /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 04:04:09.005156 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f249d615-8b67-4b78-b788-c383f40a347e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:09.005668 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f249d615-8b67-4b78-b788-c383f40a347e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:09.011754 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f249d615-8b67-4b78-b788-c383f40a347e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:09.012245 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f249d615-8b67-4b78-b788-c383f40a347e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:09.013003 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f249d615-8b67-4b78-b788-c383f40a347e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:09.013438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f249d615-8b67-4b78-b788-c383f40a347e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:09.038141 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f249d615-8b67-4b78-b788-c383f40a347e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Going to try to terminate instance {{(pid=124434) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 04:04:09.115207 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f249d615-8b67-4b78-b788-c383f40a347e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 204 len: 0 microversion: 2.1 time: 0.113523 Jul 12 04:04:09.115780 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 587/1136] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:04:09 2022] DELETE /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 04:04:09.124800 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-abe9308c-a8bb-4a96-8caf-df1f01d82a6c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:09.125475 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-abe9308c-a8bb-4a96-8caf-df1f01d82a6c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:09.134037 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-abe9308c-a8bb-4a96-8caf-df1f01d82a6c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:09.134731 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-abe9308c-a8bb-4a96-8caf-df1f01d82a6c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:09.135514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-abe9308c-a8bb-4a96-8caf-df1f01d82a6c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:09.135953 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-abe9308c-a8bb-4a96-8caf-df1f01d82a6c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:09.270933 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-abe9308c-a8bb-4a96-8caf-df1f01d82a6c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:09.278765 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-abe9308c-a8bb-4a96-8caf-df1f01d82a6c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1681 microversion: 2.1 time: 0.158551 Jul 12 04:04:09.279328 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 550/1137] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:09 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:10.301924 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d1d2ed82-b969-49c9-b1da-75263013fb5d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:10.302929 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d1d2ed82-b969-49c9-b1da-75263013fb5d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:10.314004 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1d2ed82-b969-49c9-b1da-75263013fb5d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:10.314756 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1d2ed82-b969-49c9-b1da-75263013fb5d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:10.316036 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1d2ed82-b969-49c9-b1da-75263013fb5d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:10.316893 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d1d2ed82-b969-49c9-b1da-75263013fb5d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:10.515345 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d1d2ed82-b969-49c9-b1da-75263013fb5d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:10.527512 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d1d2ed82-b969-49c9-b1da-75263013fb5d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1681 microversion: 2.1 time: 0.232914 Jul 12 04:04:10.528077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 588/1138] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:10 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:11.545356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1e83a6bf-7782-43c0-8d02-6719fa18e534 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:11.545954 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1e83a6bf-7782-43c0-8d02-6719fa18e534 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:11.552919 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1e83a6bf-7782-43c0-8d02-6719fa18e534 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:11.553374 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1e83a6bf-7782-43c0-8d02-6719fa18e534 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:11.554146 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1e83a6bf-7782-43c0-8d02-6719fa18e534 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:11.554581 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1e83a6bf-7782-43c0-8d02-6719fa18e534 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:11.643976 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1e83a6bf-7782-43c0-8d02-6719fa18e534 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:11.653008 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1e83a6bf-7782-43c0-8d02-6719fa18e534 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 200 len: 1613 microversion: 2.1 time: 0.111981 Jul 12 04:04:11.655165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 551/1139] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:11 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:11.927135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-a849fd6f-ef0d-426e-b573-6a0e85439939 req-bdd7c7cd-a794-429b-9f13-84f165f27667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b20034-9434-4ff8-b58b-1e1233ecfc8d", "name": "network-vif-deleted", "tag": "37b0d75a-57a4-4b8b-8b57-226342682fd8"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:04:11.936656 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-a849fd6f-ef0d-426e-b573-6a0e85439939 req-bdd7c7cd-a794-429b-9f13-84f165f27667 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:11.937099 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-a849fd6f-ef0d-426e-b573-6a0e85439939 req-bdd7c7cd-a794-429b-9f13-84f165f27667 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:11.948794 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-a849fd6f-ef0d-426e-b573-6a0e85439939 req-bdd7c7cd-a794-429b-9f13-84f165f27667 service nova] Creating event network-vif-deleted:37b0d75a-57a4-4b8b-8b57-226342682fd8 for instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d on hv-cinder-84773 Jul 12 04:04:11.954226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-a849fd6f-ef0d-426e-b573-6a0e85439939 req-bdd7c7cd-a794-429b-9f13-84f165f27667 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030472 Jul 12 04:04:11.955181 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 589/1140] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:04:12.671379 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1bd40d88-b15b-4dce-b982-f035b8b13743 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:12.672095 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1bd40d88-b15b-4dce-b982-f035b8b13743 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:12.679358 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1bd40d88-b15b-4dce-b982-f035b8b13743 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:12.679817 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1bd40d88-b15b-4dce-b982-f035b8b13743 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:12.680634 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1bd40d88-b15b-4dce-b982-f035b8b13743 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:12.681077 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1bd40d88-b15b-4dce-b982-f035b8b13743 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:12.694897 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-1bd40d88-b15b-4dce-b982-f035b8b13743 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1bd40d88-b15b-4dce-b982-f035b8b13743 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d HTTP/1.1 Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:04:12.696481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:04:12.698172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:04:12.698172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:04:12.698172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:04:12.698172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:04:12.698172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:04:12.698172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:04:12.698172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:04:12.698172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:04:12.698172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:04:12.698172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:04:12.698172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:04:12.698172 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'c4b20034-9434-4ff8-b58b-1e1233ecfc8d'} Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:04:12.699100 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:04:12.701079 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:12.703221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1bd40d88-b15b-4dce-b982-f035b8b13743 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 404 to user: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:04:12.703221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1bd40d88-b15b-4dce-b982-f035b8b13743 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 404 len: 111 microversion: 2.1 time: 0.030925 Jul 12 04:04:12.703221 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 552/1141] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:12 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:04:12.709070 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-909d4c8d-62f4-4f92-9873-f7fbf0d9b860 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '.version_select at 0x7fd7fa8ea5e0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:12.730399 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-909d4c8d-62f4-4f92-9873-f7fbf0d9b860 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-815570138" status: 202 len: 0 microversion: 2.1 time: 0.025978 Jul 12 04:04:12.730998 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 590/1142] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jul 12 04:04:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-815570138 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 04:04:13.436043 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-8d131d89-0681-47dd-8b31-94de83b51b15 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:13.436600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-8d131d89-0681-47dd-8b31-94de83b51b15 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:13.443154 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d131d89-0681-47dd-8b31-94de83b51b15 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:13.443600 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d131d89-0681-47dd-8b31-94de83b51b15 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:13.444402 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d131d89-0681-47dd-8b31-94de83b51b15 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:13.444834 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-8d131d89-0681-47dd-8b31-94de83b51b15 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:13.531943 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.objects.instance [None req-8d131d89-0681-47dd-8b31-94de83b51b15 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lazy-loading 'services' on Instance uuid a87f737c-428c-4c33-9622-1cb03773adf4 {{(pid=124435) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 04:04:13.612444 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-8d131d89-0681-47dd-8b31-94de83b51b15 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4/os-volume_attachments/6f4bde88-44a1-4c9f-8b25-c4fb848c6be8" status: 202 len: 0 microversion: 2.1 time: 0.180145 Jul 12 04:04:13.613063 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 553/1143] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 04:04:13 2022] DELETE /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4/os-volume_attachments/6f4bde88-44a1-4c9f-8b25-c4fb848c6be8 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 04:04:13.622306 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7045b6da-642f-4c5b-a064-ac16c6fba2d1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:13.623422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7045b6da-642f-4c5b-a064-ac16c6fba2d1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:13.631148 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7045b6da-642f-4c5b-a064-ac16c6fba2d1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:13.631731 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7045b6da-642f-4c5b-a064-ac16c6fba2d1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:13.632703 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7045b6da-642f-4c5b-a064-ac16c6fba2d1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:13.633064 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7045b6da-642f-4c5b-a064-ac16c6fba2d1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:13.662977 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7045b6da-642f-4c5b-a064-ac16c6fba2d1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045293 Jul 12 04:04:13.663632 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 591/1144] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 04:04:13 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 04:04:14.681141 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7c6cfe43-89c9-4473-a5cb-87ac05f4a2cd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:14.682867 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7c6cfe43-89c9-4473-a5cb-87ac05f4a2cd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:14.693858 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c6cfe43-89c9-4473-a5cb-87ac05f4a2cd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:14.694593 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c6cfe43-89c9-4473-a5cb-87ac05f4a2cd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:14.695858 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c6cfe43-89c9-4473-a5cb-87ac05f4a2cd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:14.696621 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c6cfe43-89c9-4473-a5cb-87ac05f4a2cd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:14.726416 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7c6cfe43-89c9-4473-a5cb-87ac05f4a2cd tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053519 Jul 12 04:04:14.726974 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 554/1145] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 04:04:14 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 04:04:14.784831 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7b9b91bd-fd7f-44db-aebe-4747431987a3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:14.785348 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7b9b91bd-fd7f-44db-aebe-4747431987a3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:14.791945 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7b9b91bd-fd7f-44db-aebe-4747431987a3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:14.792521 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7b9b91bd-fd7f-44db-aebe-4747431987a3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:14.793281 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7b9b91bd-fd7f-44db-aebe-4747431987a3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:14.793719 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7b9b91bd-fd7f-44db-aebe-4747431987a3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:14.819121 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7b9b91bd-fd7f-44db-aebe-4747431987a3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Going to try to terminate instance {{(pid=124434) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 04:04:14.908270 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7b9b91bd-fd7f-44db-aebe-4747431987a3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 204 len: 0 microversion: 2.1 time: 0.126766 Jul 12 04:04:14.908968 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 592/1146] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:04:14 2022] DELETE /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 04:04:14.918123 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-65f9c161-6b4c-4b6e-9b09-bab5e8eb4409 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:14.918758 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-65f9c161-6b4c-4b6e-9b09-bab5e8eb4409 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:14.925301 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-65f9c161-6b4c-4b6e-9b09-bab5e8eb4409 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:14.925747 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-65f9c161-6b4c-4b6e-9b09-bab5e8eb4409 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:14.926500 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-65f9c161-6b4c-4b6e-9b09-bab5e8eb4409 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:14.926946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-65f9c161-6b4c-4b6e-9b09-bab5e8eb4409 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:15.062286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-65f9c161-6b4c-4b6e-9b09-bab5e8eb4409 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:15.073238 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-65f9c161-6b4c-4b6e-9b09-bab5e8eb4409 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1681 microversion: 2.1 time: 0.158831 Jul 12 04:04:15.074000 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 555/1147] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:14 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 04:04:16.100794 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-dfc14263-4385-4b65-ab9c-2bb3bf78c6a5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:16.101940 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-dfc14263-4385-4b65-ab9c-2bb3bf78c6a5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:16.110071 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dfc14263-4385-4b65-ab9c-2bb3bf78c6a5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:16.110514 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dfc14263-4385-4b65-ab9c-2bb3bf78c6a5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:16.111269 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dfc14263-4385-4b65-ab9c-2bb3bf78c6a5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:16.111697 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-dfc14263-4385-4b65-ab9c-2bb3bf78c6a5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:16.253125 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-dfc14263-4385-4b65-ab9c-2bb3bf78c6a5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:16.261216 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-dfc14263-4385-4b65-ab9c-2bb3bf78c6a5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1681 microversion: 2.1 time: 0.167593 Jul 12 04:04:16.261882 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 593/1148] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:16 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:16.981465 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:04:16.982024 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Tue Jul 12 04:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 04:04:17.278970 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fa697aa7-fe5e-4ec6-a7ba-35315eece1d4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:17.279597 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-fa697aa7-fe5e-4ec6-a7ba-35315eece1d4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:17.286776 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fa697aa7-fe5e-4ec6-a7ba-35315eece1d4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:17.287227 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fa697aa7-fe5e-4ec6-a7ba-35315eece1d4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:17.288017 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fa697aa7-fe5e-4ec6-a7ba-35315eece1d4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:17.288476 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fa697aa7-fe5e-4ec6-a7ba-35315eece1d4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:17.481732 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-fa697aa7-fe5e-4ec6-a7ba-35315eece1d4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:17.490813 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-fa697aa7-fe5e-4ec6-a7ba-35315eece1d4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 200 len: 1681 microversion: 2.1 time: 0.215889 Jul 12 04:04:17.491422 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 556/1149] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:17 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:17.866190 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-decb7c8c-72c3-4af6-abc3-a7f4f36616db req-68a0f047-6e39-4bb1-a057-4e8e0f6ed460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87f737c-428c-4c33-9622-1cb03773adf4", "name": "network-vif-deleted", "tag": "f0b8da74-d9c0-440b-99ef-0147b592ae3d"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:04:17.877937 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-decb7c8c-72c3-4af6-abc3-a7f4f36616db req-68a0f047-6e39-4bb1-a057-4e8e0f6ed460 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:17.878622 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-decb7c8c-72c3-4af6-abc3-a7f4f36616db req-68a0f047-6e39-4bb1-a057-4e8e0f6ed460 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:17.898371 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-decb7c8c-72c3-4af6-abc3-a7f4f36616db req-68a0f047-6e39-4bb1-a057-4e8e0f6ed460 service nova] Creating event network-vif-deleted:f0b8da74-d9c0-440b-99ef-0147b592ae3d for instance a87f737c-428c-4c33-9622-1cb03773adf4 on hv-cinder-84773 Jul 12 04:04:17.905856 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-decb7c8c-72c3-4af6-abc3-a7f4f36616db req-68a0f047-6e39-4bb1-a057-4e8e0f6ed460 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045186 Jul 12 04:04:17.906911 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 594/1150] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:04:18.508801 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ae39ec76-bdf2-4383-8f11-9032c6abd224 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:18.509490 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-ae39ec76-bdf2-4383-8f11-9032c6abd224 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:18.516310 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae39ec76-bdf2-4383-8f11-9032c6abd224 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:18.516758 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae39ec76-bdf2-4383-8f11-9032c6abd224 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:18.517539 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae39ec76-bdf2-4383-8f11-9032c6abd224 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:18.517971 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-ae39ec76-bdf2-4383-8f11-9032c6abd224 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:18.532280 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-ae39ec76-bdf2-4383-8f11-9032c6abd224 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ae39ec76-bdf2-4383-8f11-9032c6abd224 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 HTTP/1.1 Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:04:18.533908 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:04:18.535514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:04:18.535514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:04:18.535514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:04:18.535514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:04:18.535514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:04:18.535514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:04:18.535514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:04:18.535514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:04:18.535514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:04:18.535514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:04:18.535514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:04:18.535514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'a87f737c-428c-4c33-9622-1cb03773adf4'} Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:04:18.536791 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:04:18.538265 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:04:18.540045 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-ae39ec76-bdf2-4383-8f11-9032c6abd224 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 404 to user: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:04:18.540045 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-ae39ec76-bdf2-4383-8f11-9032c6abd224 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 404 len: 111 microversion: 2.1 time: 0.030536 Jul 12 04:04:18.540045 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 557/1151] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:18 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:04:18.546228 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-924d1a47-94a7-46f1-80ea-e9523b797359 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '.version_select at 0x7fd7fec7a670>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:18.567253 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-924d1a47-94a7-46f1-80ea-e9523b797359 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-52845919" status: 202 len: 0 microversion: 2.1 time: 0.026417 Jul 12 04:04:18.567841 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 595/1152] 10.222.0.20 () {58 vars in 1214 bytes} [Tue Jul 12 04:04:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-52845919 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 04:04:19.455519 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1ccff38f-a625-469b-bae5-5713fcb143c7 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: .version_select at 0x7fd7fa5fe040>, body: {"keypair": {"name": "tempest-keypair-1827585606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHThlYyzx9YtLyqYfP60SnDXJiM3qlODIXnT83mp99XU70KMgl0Cw5gIV99BghVZYV1r9ggYqP0BQl3SQU/aBgAme1/5FMQdP44IMyiFa/vl8rTae/JkxdlpDw3xYR3luA=="}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:04:19.471355 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-1ccff38f-a625-469b-bae5-5713fcb143c7 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for project 5c29114118814a298f6337842ad29a9b. Resources: {'key_pairs'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 04:04:19.475406 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-1ccff38f-a625-469b-bae5-5713fcb143c7 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for user 0995483e7e7049bbb639ef3142192abe and project 5c29114118814a298f6337842ad29a9b. Resources: {'key_pairs'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 04:04:19.504256 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1ccff38f-a625-469b-bae5-5713fcb143c7 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053318 Jul 12 04:04:19.504859 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 558/1153] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 04:04:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:04:20.776688 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-122814505", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56d544be-a0fe-4e9c-9375-791b0f38b322"}], "security_groups": [{"name": "tempest-securitygroup--280786283"}], "key_name": "tempest-keypair-1827585606", "user_data": "}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:04:20.888488 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.network.neutron [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] validate_networks() for [('56d544be-a0fe-4e9c-9375-791b0f38b322', None, None, None, None, None)] {{(pid=124434) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 04:04:21.273209 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Flavor limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 04:04:21.273957 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Image limits 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 04:04:21.274734 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Flavor pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 04:04:21.275419 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Image pref 0:0:0 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 04:04:21.276220 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.virt.hardware [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124434) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 04:04:21.286227 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:21.286680 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:21.287481 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:21.287915 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:21.309151 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for project 5c29114118814a298f6337842ad29a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 04:04:21.313953 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for user 0995483e7e7049bbb639ef3142192abe and project 5c29114118814a298f6337842ad29a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 04:04:21.325899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Going to run 1 instances... {{(pid=124434) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 04:04:21.328313 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124434) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 04:04:21.375469 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-1f5d80ae-29e3-452c-8d91-d8481029b3dc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.605660 Jul 12 04:04:21.376143 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 596/1154] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 04:04:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 04:04:21.386881 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-41a672d1-73b8-48a3-9d54-62f6692feb26 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:21.387475 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-41a672d1-73b8-48a3-9d54-62f6692feb26 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:21.445210 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-41a672d1-73b8-48a3-9d54-62f6692feb26 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:21.452238 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-41a672d1-73b8-48a3-9d54-62f6692feb26 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1241 microversion: 2.1 time: 0.069780 Jul 12 04:04:21.452790 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 559/1155] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:21 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:22.470042 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-501a245b-82f1-4a64-b34e-15cca4f74677 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:22.470667 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-501a245b-82f1-4a64-b34e-15cca4f74677 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:22.477492 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-501a245b-82f1-4a64-b34e-15cca4f74677 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:22.478057 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-501a245b-82f1-4a64-b34e-15cca4f74677 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:22.478904 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-501a245b-82f1-4a64-b34e-15cca4f74677 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:22.479416 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-501a245b-82f1-4a64-b34e-15cca4f74677 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:22.543658 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-501a245b-82f1-4a64-b34e-15cca4f74677 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:22.551834 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-501a245b-82f1-4a64-b34e-15cca4f74677 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1311 microversion: 2.1 time: 0.086445 Jul 12 04:04:22.552449 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 597/1156] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:22 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:23.570750 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-11a10fe5-d699-4b9f-a391-1ae0e1a0ccbc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:23.571358 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-11a10fe5-d699-4b9f-a391-1ae0e1a0ccbc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:23.578505 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11a10fe5-d699-4b9f-a391-1ae0e1a0ccbc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:23.578956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11a10fe5-d699-4b9f-a391-1ae0e1a0ccbc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:23.579733 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11a10fe5-d699-4b9f-a391-1ae0e1a0ccbc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:23.580210 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-11a10fe5-d699-4b9f-a391-1ae0e1a0ccbc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:23.773638 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-11a10fe5-d699-4b9f-a391-1ae0e1a0ccbc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:23.782177 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-11a10fe5-d699-4b9f-a391-1ae0e1a0ccbc tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1366 microversion: 2.1 time: 0.215823 Jul 12 04:04:23.782766 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 560/1157] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:23 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:23.989710 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-f1535d87-f8d1-4ee8-9c2e-1ad986ddaf63 req-6531a233-c7db-47ec-b385-b5410e7c4d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9465d1-1641-4116-9066-de2a7f75e8bc", "tag": "482dcf1b-a4f9-4b80-bbdb-c855f58434c6"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:04:24.005354 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-f1535d87-f8d1-4ee8-9c2e-1ad986ddaf63 req-6531a233-c7db-47ec-b385-b5410e7c4d4a service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:24.005801 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-f1535d87-f8d1-4ee8-9c2e-1ad986ddaf63 req-6531a233-c7db-47ec-b385-b5410e7c4d4a service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:24.019024 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-f1535d87-f8d1-4ee8-9c2e-1ad986ddaf63 req-6531a233-c7db-47ec-b385-b5410e7c4d4a service nova] Creating event network-changed:482dcf1b-a4f9-4b80-bbdb-c855f58434c6 for instance ee9465d1-1641-4116-9066-de2a7f75e8bc on hv-cinder-84773 Jul 12 04:04:24.023985 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-f1535d87-f8d1-4ee8-9c2e-1ad986ddaf63 req-6531a233-c7db-47ec-b385-b5410e7c4d4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046220 Jul 12 04:04:24.024603 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 598/1158] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 04:04:24.799924 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-204b1bfe-65b9-4606-b0da-378adf506934 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:24.800606 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-204b1bfe-65b9-4606-b0da-378adf506934 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:24.807955 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-204b1bfe-65b9-4606-b0da-378adf506934 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:24.808470 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-204b1bfe-65b9-4606-b0da-378adf506934 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:24.809279 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-204b1bfe-65b9-4606-b0da-378adf506934 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:24.809867 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-204b1bfe-65b9-4606-b0da-378adf506934 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:24.939482 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-204b1bfe-65b9-4606-b0da-378adf506934 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:24.947513 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-204b1bfe-65b9-4606-b0da-378adf506934 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1366 microversion: 2.1 time: 0.151746 Jul 12 04:04:24.948092 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 561/1159] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:24 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:25.967866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-0228cd9e-1746-4fb4-9f26-f5e187bdf300 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:25.968912 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-0228cd9e-1746-4fb4-9f26-f5e187bdf300 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:25.979270 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0228cd9e-1746-4fb4-9f26-f5e187bdf300 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:25.979945 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0228cd9e-1746-4fb4-9f26-f5e187bdf300 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:25.981133 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0228cd9e-1746-4fb4-9f26-f5e187bdf300 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:25.981721 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-0228cd9e-1746-4fb4-9f26-f5e187bdf300 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:26.111352 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-0228cd9e-1746-4fb4-9f26-f5e187bdf300 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:26.119462 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-0228cd9e-1746-4fb4-9f26-f5e187bdf300 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1366 microversion: 2.1 time: 0.158273 Jul 12 04:04:26.120055 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 599/1160] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:25 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:27.141887 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-fb0ab25b-4072-451f-acec-4814d4f7e77d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:27.142661 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-fb0ab25b-4072-451f-acec-4814d4f7e77d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:27.152129 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fb0ab25b-4072-451f-acec-4814d4f7e77d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:27.152773 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fb0ab25b-4072-451f-acec-4814d4f7e77d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:27.153919 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fb0ab25b-4072-451f-acec-4814d4f7e77d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:27.154348 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-fb0ab25b-4072-451f-acec-4814d4f7e77d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:27.351296 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-fb0ab25b-4072-451f-acec-4814d4f7e77d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:27.359360 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-fb0ab25b-4072-451f-acec-4814d4f7e77d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1366 microversion: 2.1 time: 0.225797 Jul 12 04:04:27.359937 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 562/1161] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:27 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:28.376721 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-2856c874-b02e-46e2-99b0-7a542af95600 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:28.377349 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-2856c874-b02e-46e2-99b0-7a542af95600 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:28.383944 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2856c874-b02e-46e2-99b0-7a542af95600 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:28.384427 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2856c874-b02e-46e2-99b0-7a542af95600 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:28.385176 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2856c874-b02e-46e2-99b0-7a542af95600 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:28.385602 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-2856c874-b02e-46e2-99b0-7a542af95600 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:28.521976 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-2856c874-b02e-46e2-99b0-7a542af95600 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:28.529990 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-2856c874-b02e-46e2-99b0-7a542af95600 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1366 microversion: 2.1 time: 0.157196 Jul 12 04:04:28.530554 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 600/1162] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:28 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:29.556078 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1c84b5e3-7465-4099-b734-2dd20dc7da30 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:29.557046 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1c84b5e3-7465-4099-b734-2dd20dc7da30 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:29.568666 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c84b5e3-7465-4099-b734-2dd20dc7da30 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:29.569421 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c84b5e3-7465-4099-b734-2dd20dc7da30 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:29.570745 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c84b5e3-7465-4099-b734-2dd20dc7da30 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:29.571477 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c84b5e3-7465-4099-b734-2dd20dc7da30 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:29.706521 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-1c84b5e3-7465-4099-b734-2dd20dc7da30 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:29.714359 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1c84b5e3-7465-4099-b734-2dd20dc7da30 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1366 microversion: 2.1 time: 0.165082 Jul 12 04:04:29.714915 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 563/1163] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:29 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:29.765170 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-58d88709-15c8-49a2-9dbc-55967317a326 req-eeac31ee-2307-43b5-a37a-b004ef68a8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9465d1-1641-4116-9066-de2a7f75e8bc", "name": "network-vif-plugged", "status": "completed", "tag": "482dcf1b-a4f9-4b80-bbdb-c855f58434c6"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:04:29.774955 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-58d88709-15c8-49a2-9dbc-55967317a326 req-eeac31ee-2307-43b5-a37a-b004ef68a8b2 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:29.775679 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-58d88709-15c8-49a2-9dbc-55967317a326 req-eeac31ee-2307-43b5-a37a-b004ef68a8b2 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:29.788775 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-58d88709-15c8-49a2-9dbc-55967317a326 req-eeac31ee-2307-43b5-a37a-b004ef68a8b2 service nova] Creating event network-vif-plugged:482dcf1b-a4f9-4b80-bbdb-c855f58434c6 for instance ee9465d1-1641-4116-9066-de2a7f75e8bc on hv-cinder-84773 Jul 12 04:04:29.793759 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-58d88709-15c8-49a2-9dbc-55967317a326 req-eeac31ee-2307-43b5-a37a-b004ef68a8b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032452 Jul 12 04:04:29.794472 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 601/1164] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:04:30.735125 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-96959756-2344-4bbe-94ba-4bc7b640caf3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:30.736123 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-96959756-2344-4bbe-94ba-4bc7b640caf3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:30.747511 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-96959756-2344-4bbe-94ba-4bc7b640caf3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:30.747960 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-96959756-2344-4bbe-94ba-4bc7b640caf3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:30.748765 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-96959756-2344-4bbe-94ba-4bc7b640caf3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:30.749205 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-96959756-2344-4bbe-94ba-4bc7b640caf3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:30.890204 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-96959756-2344-4bbe-94ba-4bc7b640caf3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:30.898116 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-96959756-2344-4bbe-94ba-4bc7b640caf3 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1366 microversion: 2.1 time: 0.169683 Jul 12 04:04:30.898700 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 564/1165] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:30 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:31.912394 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:04:31.913208 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=6 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:04:31.918068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4227c6b5-2221-40b4-b556-01ae575ea937 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:31.918811 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4227c6b5-2221-40b4-b556-01ae575ea937 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:31.926675 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4227c6b5-2221-40b4-b556-01ae575ea937 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:31.927181 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4227c6b5-2221-40b4-b556-01ae575ea937 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:31.927975 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4227c6b5-2221-40b4-b556-01ae575ea937 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:31.928640 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4227c6b5-2221-40b4-b556-01ae575ea937 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:32.061647 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4227c6b5-2221-40b4-b556-01ae575ea937 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:04:32.069562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4227c6b5-2221-40b4-b556-01ae575ea937 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1556 microversion: 2.1 time: 0.158705 Jul 12 04:04:32.070136 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 602/1166] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:04:31 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:04:32.086229 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d0b89ba7-e8b4-4ca2-9e8d-5b71af289d4f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:04:32.086779 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d0b89ba7-e8b4-4ca2-9e8d-5b71af289d4f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:04:32.088930 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=6 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:04:32.095032 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d0b89ba7-e8b4-4ca2-9e8d-5b71af289d4f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:32.095483 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d0b89ba7-e8b4-4ca2-9e8d-5b71af289d4f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:32.096295 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d0b89ba7-e8b4-4ca2-9e8d-5b71af289d4f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:32.096732 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d0b89ba7-e8b4-4ca2-9e8d-5b71af289d4f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:32.184418 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d0b89ba7-e8b4-4ca2-9e8d-5b71af289d4f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102156 Jul 12 04:04:32.185029 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 565/1167] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 04:04:32 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:04:33.195783 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-8234e629-4cd3-4f13-a982-264f441712da req-ce9496bf-3940-4744-a2c7-63d744680d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9465d1-1641-4116-9066-de2a7f75e8bc", "tag": "482dcf1b-a4f9-4b80-bbdb-c855f58434c6"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:04:33.204490 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-8234e629-4cd3-4f13-a982-264f441712da req-ce9496bf-3940-4744-a2c7-63d744680d32 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:04:33.204937 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-8234e629-4cd3-4f13-a982-264f441712da req-ce9496bf-3940-4744-a2c7-63d744680d32 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:04:33.216284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-8234e629-4cd3-4f13-a982-264f441712da req-ce9496bf-3940-4744-a2c7-63d744680d32 service nova] Creating event network-changed:482dcf1b-a4f9-4b80-bbdb-c855f58434c6 for instance ee9465d1-1641-4116-9066-de2a7f75e8bc on hv-cinder-84773 Jul 12 04:04:33.221185 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-8234e629-4cd3-4f13-a982-264f441712da req-ce9496bf-3940-4744-a2c7-63d744680d32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086711 Jul 12 04:04:33.221949 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 603/1168] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:05:26.058646 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:05:26.059309 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a42bcfba-dd43-47d6-8c1f-42a7dce75111 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:26.059678 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:05:26.059775 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a42bcfba-dd43-47d6-8c1f-42a7dce75111 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:26.063837 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [req-f962878c-f56a-494d-92a8-aa3200af3d32 req-15789c0d-e738-4928-aedb-47c72ed65f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b74d356-e773-4d8b-85cf-b31c80c2aef3", "tag": "c31ca6c3-cf04-4828-a8bf-1c95239cd2d1"}]} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:05:26.067754 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:05:26.068651 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:05:26.070500 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a42bcfba-dd43-47d6-8c1f-42a7dce75111 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:26.071040 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a42bcfba-dd43-47d6-8c1f-42a7dce75111 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:26.072299 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a42bcfba-dd43-47d6-8c1f-42a7dce75111 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:26.072706 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a42bcfba-dd43-47d6-8c1f-42a7dce75111 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:26.086563 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-f962878c-f56a-494d-92a8-aa3200af3d32 req-15789c0d-e738-4928-aedb-47c72ed65f54 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:26.087000 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [req-f962878c-f56a-494d-92a8-aa3200af3d32 req-15789c0d-e738-4928-aedb-47c72ed65f54 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:26.103010 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.compute.server_external_events [req-f962878c-f56a-494d-92a8-aa3200af3d32 req-15789c0d-e738-4928-aedb-47c72ed65f54 service nova] Creating event network-changed:c31ca6c3-cf04-4828-a8bf-1c95239cd2d1 for instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3 on hv-cinder-84773 Jul 12 04:05:26.104030 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a42bcfba-dd43-47d6-8c1f-42a7dce75111 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 04:05:26.109336 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [req-f962878c-f56a-494d-92a8-aa3200af3d32 req-15789c0d-e738-4928-aedb-47c72ed65f54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052210 Jul 12 04:05:26.110263 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 604/1169] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:05:26.196380 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a42bcfba-dd43-47d6-8c1f-42a7dce75111 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 204 len: 0 microversion: 2.1 time: 0.141313 Jul 12 04:05:26.197183 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 566/1170] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:05:26 2022] DELETE /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 04:05:26.208916 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-83ee73ec-6b3a-4844-a25e-91ba89c2dcc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:26.209840 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-83ee73ec-6b3a-4844-a25e-91ba89c2dcc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:26.218076 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-83ee73ec-6b3a-4844-a25e-91ba89c2dcc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:26.218527 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-83ee73ec-6b3a-4844-a25e-91ba89c2dcc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:26.219301 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-83ee73ec-6b3a-4844-a25e-91ba89c2dcc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:26.219728 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-83ee73ec-6b3a-4844-a25e-91ba89c2dcc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:26.358419 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-83ee73ec-6b3a-4844-a25e-91ba89c2dcc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:05:26.366490 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-83ee73ec-6b3a-4844-a25e-91ba89c2dcc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.164547 Jul 12 04:05:26.367077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 605/1171] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:05:26 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:05:27.385618 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-e2508ab1-1aa3-4b0c-a7b5-5d021da6bbc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:27.386322 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-e2508ab1-1aa3-4b0c-a7b5-5d021da6bbc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:27.393264 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e2508ab1-1aa3-4b0c-a7b5-5d021da6bbc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:27.393712 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e2508ab1-1aa3-4b0c-a7b5-5d021da6bbc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:27.394481 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e2508ab1-1aa3-4b0c-a7b5-5d021da6bbc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:27.394918 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-e2508ab1-1aa3-4b0c-a7b5-5d021da6bbc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:27.581250 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-e2508ab1-1aa3-4b0c-a7b5-5d021da6bbc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:05:27.589320 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-e2508ab1-1aa3-4b0c-a7b5-5d021da6bbc0 tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1569 microversion: 2.1 time: 0.208075 Jul 12 04:05:27.590017 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 567/1172] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:05:27 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:05:28.606962 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-7af8d08d-d892-4545-83e6-79f6ba7ed29a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:28.607569 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-7af8d08d-d892-4545-83e6-79f6ba7ed29a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:28.614836 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7af8d08d-d892-4545-83e6-79f6ba7ed29a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:28.615284 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7af8d08d-d892-4545-83e6-79f6ba7ed29a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:28.616095 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7af8d08d-d892-4545-83e6-79f6ba7ed29a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:28.616531 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-7af8d08d-d892-4545-83e6-79f6ba7ed29a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:28.746404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-7af8d08d-d892-4545-83e6-79f6ba7ed29a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:05:28.754539 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-7af8d08d-d892-4545-83e6-79f6ba7ed29a tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1451 microversion: 2.1 time: 0.151557 Jul 12 04:05:28.755135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 606/1173] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:05:28 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:05:28.900707 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-a6384d72-519c-4491-85fc-91f2732d4f78 req-05bf5814-e93a-45d2-b191-1d4a4c1cd722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b74d356-e773-4d8b-85cf-b31c80c2aef3", "name": "network-vif-deleted", "tag": "c31ca6c3-cf04-4828-a8bf-1c95239cd2d1"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:05:28.911383 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-a6384d72-519c-4491-85fc-91f2732d4f78 req-05bf5814-e93a-45d2-b191-1d4a4c1cd722 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:28.911826 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-a6384d72-519c-4491-85fc-91f2732d4f78 req-05bf5814-e93a-45d2-b191-1d4a4c1cd722 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:28.924704 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-a6384d72-519c-4491-85fc-91f2732d4f78 req-05bf5814-e93a-45d2-b191-1d4a4c1cd722 service nova] Creating event network-vif-deleted:c31ca6c3-cf04-4828-a8bf-1c95239cd2d1 for instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3 on hv-cinder-84773 Jul 12 04:05:28.930226 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-a6384d72-519c-4491-85fc-91f2732d4f78 req-05bf5814-e93a-45d2-b191-1d4a4c1cd722 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033249 Jul 12 04:05:28.930895 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 568/1174] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:05:29.771622 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f1dd7b76-ae68-4aef-92e8-4d18dbe424ad tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:29.772288 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f1dd7b76-ae68-4aef-92e8-4d18dbe424ad tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:29.779016 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1dd7b76-ae68-4aef-92e8-4d18dbe424ad tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:29.779527 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1dd7b76-ae68-4aef-92e8-4d18dbe424ad tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:29.780371 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1dd7b76-ae68-4aef-92e8-4d18dbe424ad tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:29.780811 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1dd7b76-ae68-4aef-92e8-4d18dbe424ad tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:29.812964 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1dd7b76-ae68-4aef-92e8-4d18dbe424ad tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:29.813416 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f1dd7b76-ae68-4aef-92e8-4d18dbe424ad tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:29.813866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-f1dd7b76-ae68-4aef-92e8-4d18dbe424ad tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lazy-loading 'fault' on Instance uuid 1b74d356-e773-4d8b-85cf-b31c80c2aef3 {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 04:05:29.857752 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f1dd7b76-ae68-4aef-92e8-4d18dbe424ad tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5991e17e8dfb4a59a4dd1a4da24ff90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac1a71ff09f4ae38a5c3704fc43a950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:05:29.864767 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f1dd7b76-ae68-4aef-92e8-4d18dbe424ad tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 200 len: 1179 microversion: 2.1 time: 0.097798 Jul 12 04:05:29.865344 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 607/1175] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:05:29 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 1179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:05:30.882527 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1c9aed0a-b48f-465b-8a1c-cdf36711859e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:30.883165 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-1c9aed0a-b48f-465b-8a1c-cdf36711859e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] [instance: 1b74d356-e773-4d8b-85cf-b31c80c2aef3] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:30.890262 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c9aed0a-b48f-465b-8a1c-cdf36711859e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:30.890718 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c9aed0a-b48f-465b-8a1c-cdf36711859e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:30.891598 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c9aed0a-b48f-465b-8a1c-cdf36711859e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:30.892067 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-1c9aed0a-b48f-465b-8a1c-cdf36711859e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:30.906199 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-1c9aed0a-b48f-465b-8a1c-cdf36711859e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] HTTP exception thrown: Instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3 could not be found. Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1c9aed0a-b48f-465b-8a1c-cdf36711859e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Request method failure captured: Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 HTTP/1.1 Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPGc_VM9dxBtRkebX2Yqzsejd0l6JOAZFRWhvRnhsHYoG8BFTt0iu2Lg7VJR6RT_dnHrkj1CBLSyect3w-QXhFObfs8LG0Ify3jw_3VuUTyO_a0DbLtQbS7-IkpgwajLDgIhydrf2egsd3e5PHXWlxV78AcCGtXYACHvazHCK7yYuvM Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: aac1a71ff09f4ae38a5c3704fc43a950 Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-TestShelveInstance-1667516273 Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:05:30.907902 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:05:30.909557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aac1a71ff09f4ae38a5c3704fc43a950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aac1a71ff09f4ae38a5c3704fc43a950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aac1a71ff09f4ae38a5c3704fc43a950"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aac1a71ff09f4ae38a5c3704fc43a950"}]}] Jul 12 04:05:30.909557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-TestShelveInstance-1667516273 Jul 12 04:05:30.909557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: aac1a71ff09f4ae38a5c3704fc43a950 Jul 12 04:05:30.909557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-TestShelveInstance-1667516273 Jul 12 04:05:30.909557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-TestShelveInstance-1667516273-project Jul 12 04:05:30.909557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:05:30.909557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:05:30.909557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 5991e17e8dfb4a59a4dd1a4da24ff90c Jul 12 04:05:30.909557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-TestShelveInstance-1667516273-project Jul 12 04:05:30.909557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:05:30.909557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3 could not be found. Jul 12 04:05:30.909557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': '1b74d356-e773-4d8b-85cf-b31c80c2aef3'} Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3 could not be found. Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:05:30.910993 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3 could not be found. Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3 could not be found. Jul 12 04:05:30.912557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:05:30.914802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-1c9aed0a-b48f-465b-8a1c-cdf36711859e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Returning 404 to user: Instance 1b74d356-e773-4d8b-85cf-b31c80c2aef3 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:05:30.914802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-1c9aed0a-b48f-465b-8a1c-cdf36711859e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3" status: 404 len: 111 microversion: 2.1 time: 0.031107 Jul 12 04:05:30.914802 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 569/1176] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:05:30 2022] GET /compute/v2.1/servers/1b74d356-e773-4d8b-85cf-b31c80c2aef3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:05:31.076711 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8f7dc5a6-61de-4332-a252-73e2bb6c5f8e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] Calling method '.version_select at 0x7fd7fec529d0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:31.099668 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8f7dc5a6-61de-4332-a252-73e2bb6c5f8e tempest-TestShelveInstance-1667516273 tempest-TestShelveInstance-1667516273-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2018960855" status: 202 len: 0 microversion: 2.1 time: 0.026703 Jul 12 04:05:31.100377 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 608/1177] 10.222.0.20 () {58 vars in 1253 bytes} [Tue Jul 12 04:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2018960855 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 04:05:48.214019 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:05:48.215257 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:05:48.450593 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-625fc16e-210b-479d-bfcb-1f6e54577af1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:48.451247 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-625fc16e-210b-479d-bfcb-1f6e54577af1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:48.459293 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-625fc16e-210b-479d-bfcb-1f6e54577af1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:48.459743 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-625fc16e-210b-479d-bfcb-1f6e54577af1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:48.460553 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-625fc16e-210b-479d-bfcb-1f6e54577af1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:48.460987 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-625fc16e-210b-479d-bfcb-1f6e54577af1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:48.484106 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-625fc16e-210b-479d-bfcb-1f6e54577af1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/ips" status: 200 len: 150 microversion: 2.1 time: 0.279153 Jul 12 04:05:48.484663 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 570/1178] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 04:05:48 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/ips => generated 150 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:05:49.820600 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=22 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:05:49.821353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:05:49.826013 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-bebae94b-f345-48f0-8dbe-0e54273489d9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03f9234d-48d6-4f9b-a12f-f3797e44ba8d"}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:05:49.827071 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-bebae94b-f345-48f0-8dbe-0e54273489d9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:49.835161 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bebae94b-f345-48f0-8dbe-0e54273489d9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:49.835612 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bebae94b-f345-48f0-8dbe-0e54273489d9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:49.836422 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bebae94b-f345-48f0-8dbe-0e54273489d9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:49.836858 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bebae94b-f345-48f0-8dbe-0e54273489d9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:50.110406 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-bebae94b-f345-48f0-8dbe-0e54273489d9 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291112 Jul 12 04:05:50.111022 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 609/1179] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 04:05:49 2022] POST /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:05:57.323346 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:05:57.324020 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Tue Jul 12 04:05:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 04:05:57.683825 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3d898e8c-122e-43f4-89ea-e76f19eecd51 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03f9234d-48d6-4f9b-a12f-f3797e44ba8d"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:05:57.685136 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-3d898e8c-122e-43f4-89ea-e76f19eecd51 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:57.691941 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3d898e8c-122e-43f4-89ea-e76f19eecd51 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:57.692443 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3d898e8c-122e-43f4-89ea-e76f19eecd51 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:57.693211 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3d898e8c-122e-43f4-89ea-e76f19eecd51 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:57.693648 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-3d898e8c-122e-43f4-89ea-e76f19eecd51 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:57.799781 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-3d898e8c-122e-43f4-89ea-e76f19eecd51 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Invalid volume: volume 03f9234d-48d6-4f9b-a12f-f3797e44ba8d is already attached to instances: ee9465d1-1641-4116-9066-de2a7f75e8bc Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3d898e8c-122e-43f4-89ea-e76f19eecd51 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: POST /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-volume_attachments HTTP/1.1 Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 74 Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:05:57.801433 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:05:57.803081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:05:57.803081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:05:57.803081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:05:57.803081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:05:57.803081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:05:57.803081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:05:57.803081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:05:57.803081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:05:57.803081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:05:57.803081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Jul 12 04:05:57.803081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {"volumeAttachment": {"volumeId": "03f9234d-48d6-4f9b-a12f-f3797e44ba8d"}} Jul 12 04:05:57.803081 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Invalid volume: volume 03f9234d-48d6-4f9b-a12f-f3797e44ba8d is already attached to instances: ee9465d1-1641-4116-9066-de2a7f75e8bc Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'server_id': 'ee9465d1-1641-4116-9066-de2a7f75e8bc', 'body': {'volumeAttachment': {'volumeId': '03f9234d-48d6-4f9b-a12f-f3797e44ba8d'}}} Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 03f9234d-48d6-4f9b-a12f-f3797e44ba8d is already attached to instances: ee9465d1-1641-4116-9066-de2a7f75e8bc Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:05:57.804128 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 03f9234d-48d6-4f9b-a12f-f3797e44ba8d is already attached to instances: ee9465d1-1641-4116-9066-de2a7f75e8bc Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:05:57.805770 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:05:57.807592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:05:57.807592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:05:57.807592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:05:57.807592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 03f9234d-48d6-4f9b-a12f-f3797e44ba8d is already attached to instances: ee9465d1-1641-4116-9066-de2a7f75e8bc Jul 12 04:05:57.807592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:05:57.807592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-3d898e8c-122e-43f4-89ea-e76f19eecd51 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 400 to user: Invalid volume: volume 03f9234d-48d6-4f9b-a12f-f3797e44ba8d is already attached to instances: ee9465d1-1641-4116-9066-de2a7f75e8bc {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:05:57.807592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-3d898e8c-122e-43f4-89ea-e76f19eecd51 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123275 Jul 12 04:05:57.807592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 571/1180] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 04:05:57 2022] POST /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 04:05:57.875010 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-603821f3-3fe8-429a-bac8-daaf29ec890f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:57.875586 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-603821f3-3fe8-429a-bac8-daaf29ec890f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:57.884695 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-603821f3-3fe8-429a-bac8-daaf29ec890f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:57.885376 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-603821f3-3fe8-429a-bac8-daaf29ec890f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:57.886591 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-603821f3-3fe8-429a-bac8-daaf29ec890f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:57.887331 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-603821f3-3fe8-429a-bac8-daaf29ec890f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:57.988665 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-603821f3-3fe8-429a-bac8-daaf29ec890f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lazy-loading 'services' on Instance uuid ee9465d1-1641-4116-9066-de2a7f75e8bc {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 04:05:58.072459 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-603821f3-3fe8-429a-bac8-daaf29ec890f tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-volume_attachments/03f9234d-48d6-4f9b-a12f-f3797e44ba8d" status: 202 len: 0 microversion: 2.1 time: 0.205058 Jul 12 04:05:58.073085 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 610/1181] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 04:05:57 2022] DELETE /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-volume_attachments/03f9234d-48d6-4f9b-a12f-f3797e44ba8d => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 04:05:58.083500 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d6b7bd76-7160-4266-9db0-108eb56f3757 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:58.084474 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d6b7bd76-7160-4266-9db0-108eb56f3757 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:58.091356 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d6b7bd76-7160-4266-9db0-108eb56f3757 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:58.091946 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d6b7bd76-7160-4266-9db0-108eb56f3757 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:58.092815 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d6b7bd76-7160-4266-9db0-108eb56f3757 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:58.093256 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d6b7bd76-7160-4266-9db0-108eb56f3757 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:58.128557 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d6b7bd76-7160-4266-9db0-108eb56f3757 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048959 Jul 12 04:05:58.129039 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 572/1182] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 04:05:58 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:05:59.144161 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b33d5f9c-9de4-4377-a98c-2255d290dce8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:59.145332 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b33d5f9c-9de4-4377-a98c-2255d290dce8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:59.152314 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b33d5f9c-9de4-4377-a98c-2255d290dce8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:59.152543 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b33d5f9c-9de4-4377-a98c-2255d290dce8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:59.153597 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b33d5f9c-9de4-4377-a98c-2255d290dce8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:59.154110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b33d5f9c-9de4-4377-a98c-2255d290dce8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:59.186799 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b33d5f9c-9de4-4377-a98c-2255d290dce8 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048119 Jul 12 04:05:59.187357 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 611/1183] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 04:05:59 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 04:05:59.246911 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-08cbf713-8d46-44e1-ad60-60cff6256b14 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:59.247428 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-08cbf713-8d46-44e1-ad60-60cff6256b14 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:59.254448 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-08cbf713-8d46-44e1-ad60-60cff6256b14 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:59.254900 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-08cbf713-8d46-44e1-ad60-60cff6256b14 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:59.255662 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-08cbf713-8d46-44e1-ad60-60cff6256b14 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:59.256139 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-08cbf713-8d46-44e1-ad60-60cff6256b14 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:59.281104 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-08cbf713-8d46-44e1-ad60-60cff6256b14 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 04:05:59.367398 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-08cbf713-8d46-44e1-ad60-60cff6256b14 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 204 len: 0 microversion: 2.1 time: 0.124195 Jul 12 04:05:59.368025 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 573/1184] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:05:59 2022] DELETE /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 04:05:59.376688 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-4f5dc45f-34b4-4e0a-91d8-fa3e560e76d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:05:59.377357 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-4f5dc45f-34b4-4e0a-91d8-fa3e560e76d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:05:59.383445 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4f5dc45f-34b4-4e0a-91d8-fa3e560e76d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:59.383831 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4f5dc45f-34b4-4e0a-91d8-fa3e560e76d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:59.384655 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4f5dc45f-34b4-4e0a-91d8-fa3e560e76d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:05:59.385085 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-4f5dc45f-34b4-4e0a-91d8-fa3e560e76d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:05:59.528577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-4f5dc45f-34b4-4e0a-91d8-fa3e560e76d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:05:59.536541 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-4f5dc45f-34b4-4e0a-91d8-fa3e560e76d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1681 microversion: 2.1 time: 0.163754 Jul 12 04:05:59.537487 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 612/1185] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:05:59 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:00.559437 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-353099e0-e543-4290-8945-d16f22dac3a0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:00.560636 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-353099e0-e543-4290-8945-d16f22dac3a0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:00.571649 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-353099e0-e543-4290-8945-d16f22dac3a0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:00.572462 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-353099e0-e543-4290-8945-d16f22dac3a0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:00.573723 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-353099e0-e543-4290-8945-d16f22dac3a0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:00.574566 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-353099e0-e543-4290-8945-d16f22dac3a0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:00.712514 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-353099e0-e543-4290-8945-d16f22dac3a0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:06:00.720239 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-353099e0-e543-4290-8945-d16f22dac3a0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1681 microversion: 2.1 time: 0.167980 Jul 12 04:06:00.720818 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 574/1186] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:00 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:01.737861 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-5826138d-fd86-435c-8e1c-d07f975bfc5e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:01.738495 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-5826138d-fd86-435c-8e1c-d07f975bfc5e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:01.745269 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5826138d-fd86-435c-8e1c-d07f975bfc5e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:01.745734 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5826138d-fd86-435c-8e1c-d07f975bfc5e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:01.746581 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5826138d-fd86-435c-8e1c-d07f975bfc5e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:01.747005 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-5826138d-fd86-435c-8e1c-d07f975bfc5e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:01.810171 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-5826138d-fd86-435c-8e1c-d07f975bfc5e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:06:01.818009 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-5826138d-fd86-435c-8e1c-d07f975bfc5e tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 200 len: 1614 microversion: 2.1 time: 0.084092 Jul 12 04:06:01.818833 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 613/1187] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:01 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:02.069500 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-ffeec24e-f897-47c8-ba2d-0616b4fe05fa req-ea3064ee-f788-4a3f-a275-ac1988d2193e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9465d1-1641-4116-9066-de2a7f75e8bc", "name": "network-vif-deleted", "tag": "482dcf1b-a4f9-4b80-bbdb-c855f58434c6"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:06:02.095786 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-ffeec24e-f897-47c8-ba2d-0616b4fe05fa req-ea3064ee-f788-4a3f-a275-ac1988d2193e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:02.096278 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-ffeec24e-f897-47c8-ba2d-0616b4fe05fa req-ea3064ee-f788-4a3f-a275-ac1988d2193e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:02.111419 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-ffeec24e-f897-47c8-ba2d-0616b4fe05fa req-ea3064ee-f788-4a3f-a275-ac1988d2193e service nova] Creating event network-vif-deleted:482dcf1b-a4f9-4b80-bbdb-c855f58434c6 for instance ee9465d1-1641-4116-9066-de2a7f75e8bc on hv-cinder-84773 Jul 12 04:06:02.116432 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-ffeec24e-f897-47c8-ba2d-0616b4fe05fa req-ea3064ee-f788-4a3f-a275-ac1988d2193e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126013 Jul 12 04:06:02.117354 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 575/1188] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:06:02.835025 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8c6e2ae7-a106-4b8e-baf6-821e5c9a4247 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:02.835634 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-8c6e2ae7-a106-4b8e-baf6-821e5c9a4247 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:02.842532 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8c6e2ae7-a106-4b8e-baf6-821e5c9a4247 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:02.843177 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8c6e2ae7-a106-4b8e-baf6-821e5c9a4247 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:02.843871 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8c6e2ae7-a106-4b8e-baf6-821e5c9a4247 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:02.845161 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-8c6e2ae7-a106-4b8e-baf6-821e5c9a4247 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:02.859846 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-8c6e2ae7-a106-4b8e-baf6-821e5c9a4247 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8c6e2ae7-a106-4b8e-baf6-821e5c9a4247 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc HTTP/1.1 Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:06:02.861480 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:06:02.863135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:06:02.863135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:06:02.863135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:06:02.863135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:06:02.863135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:06:02.863135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:06:02.863135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:06:02.863135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:06:02.863135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:06:02.863135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:06:02.863135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:06:02.863135 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'ee9465d1-1641-4116-9066-de2a7f75e8bc'} Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:06:02.867413 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:06:02.869118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:06:02.870549 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-8c6e2ae7-a106-4b8e-baf6-821e5c9a4247 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 404 to user: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:06:02.870549 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-8c6e2ae7-a106-4b8e-baf6-821e5c9a4247 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 404 len: 111 microversion: 2.1 time: 0.031884 Jul 12 04:06:02.870549 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 614/1189] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:02 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:06:02.873119 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-898df3fe-2291-48fd-84a3-8287daa706fe tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '.version_select at 0x7fd7fa5ffb80>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:02.891880 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-898df3fe-2291-48fd-84a3-8287daa706fe tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827585606" status: 202 len: 0 microversion: 2.1 time: 0.023186 Jul 12 04:06:02.892522 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 576/1190] 10.222.0.20 () {58 vars in 1220 bytes} [Tue Jul 12 04:06:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827585606 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 04:06:03.515813 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-247d65c7-3914-4231-9a65-5b3d6de2e854 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: .version_select at 0x7fd7fa788a60>, body: {"keypair": {"name": "tempest-keypair-397210675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBv8hhOd0V/2qyvRKL8Cn/HgPoOBldU12ZtC1WGTcLVk0JG+p3iE5DcsKkTzGbV2Bva4Cl3fXY6DwV87uMPREMvlDmEk0spqVD9AEbc92tmlepzomBA2KhPSEXPWXiZnpg=="}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:06:03.530040 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-247d65c7-3914-4231-9a65-5b3d6de2e854 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for project 5c29114118814a298f6337842ad29a9b. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 04:06:03.533875 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.quota [None req-247d65c7-3914-4231-9a65-5b3d6de2e854 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for user 0995483e7e7049bbb639ef3142192abe and project 5c29114118814a298f6337842ad29a9b. Resources: {'key_pairs'} {{(pid=124434) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 04:06:03.560936 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-247d65c7-3914-4231-9a65-5b3d6de2e854 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049836 Jul 12 04:06:03.561506 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 615/1191] 10.222.0.20 () {60 vars in 1158 bytes} [Tue Jul 12 04:06:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:06:05.064719 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1877539201", "imageRef": "72d3e9ef-9534-49b3-b697-ca678250fdbc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56d544be-a0fe-4e9c-9375-791b0f38b322"}], "security_groups": [{"name": "tempest-securitygroup--1683730509"}], "key_name": "tempest-keypair-397210675", "user_data": "}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:06:05.168136 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.network.neutron [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] validate_networks() for [('56d544be-a0fe-4e9c-9375-791b0f38b322', None, None, None, None, None)] {{(pid=124435) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 04:06:05.542297 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Flavor limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 04:06:05.542919 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Image limits 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 04:06:05.543876 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Flavor pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 04:06:05.544529 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Image pref 0:0:0 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 04:06:05.545207 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.virt.hardware [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124435) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 04:06:05.559607 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:05.560048 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:05.560865 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:05.561295 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:05.584272 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for project 5c29114118814a298f6337842ad29a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 04:06:05.592989 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.quota [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Getting quotas for user 0995483e7e7049bbb639ef3142192abe and project 5c29114118814a298f6337842ad29a9b. Resources: {'instances', 'cores', 'ram'} {{(pid=124435) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 04:06:05.605146 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Going to run 1 instances... {{(pid=124435) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 04:06:05.607541 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72d3e9ef-9534-49b3-b697-ca678250fdbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124435) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 04:06:05.657156 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7350aa86-e122-4a5c-8e04-1d4aa1311120 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597419 Jul 12 04:06:05.657827 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 577/1192] 10.222.0.20 () {60 vars in 1146 bytes} [Tue Jul 12 04:06:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 04:06:05.669645 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-91b59bbe-b127-449a-b28e-71a1af851657 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:05.670250 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-91b59bbe-b127-449a-b28e-71a1af851657 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:05.723734 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-91b59bbe-b127-449a-b28e-71a1af851657 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:06:05.730508 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-91b59bbe-b127-449a-b28e-71a1af851657 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1241 microversion: 2.1 time: 0.065647 Jul 12 04:06:05.731188 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 616/1193] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:05 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:06.747394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d530ceda-7c70-45f0-bbd6-d3fac63b2156 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:06.748131 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d530ceda-7c70-45f0-bbd6-d3fac63b2156 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:06.755346 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d530ceda-7c70-45f0-bbd6-d3fac63b2156 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:06.755870 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d530ceda-7c70-45f0-bbd6-d3fac63b2156 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:06.756664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d530ceda-7c70-45f0-bbd6-d3fac63b2156 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:06.757092 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d530ceda-7c70-45f0-bbd6-d3fac63b2156 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:06.826450 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d530ceda-7c70-45f0-bbd6-d3fac63b2156 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:06:06.834771 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d530ceda-7c70-45f0-bbd6-d3fac63b2156 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1301 microversion: 2.1 time: 0.091750 Jul 12 04:06:06.835639 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 578/1194] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:06 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:07.853817 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-b2b89a99-a12a-4860-a081-ba607925e24d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:07.854449 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-b2b89a99-a12a-4860-a081-ba607925e24d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:07.861048 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b2b89a99-a12a-4860-a081-ba607925e24d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:07.861594 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b2b89a99-a12a-4860-a081-ba607925e24d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:07.862463 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b2b89a99-a12a-4860-a081-ba607925e24d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:07.862993 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-b2b89a99-a12a-4860-a081-ba607925e24d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:07.995154 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-b2b89a99-a12a-4860-a081-ba607925e24d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:06:08.003366 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-b2b89a99-a12a-4860-a081-ba607925e24d tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1367 microversion: 2.1 time: 0.154515 Jul 12 04:06:08.003933 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 617/1195] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:07 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:08.253724 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-63478f9b-b546-4660-9ccb-16948497dabc req-2670f2e1-a883-46d9-be9e-785d84f03a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893f39eb-39b0-459b-b5a6-53da3ff61552", "tag": "84959274-d5ae-4d69-b800-e59f99fc83a8"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:06:08.267270 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-63478f9b-b546-4660-9ccb-16948497dabc req-2670f2e1-a883-46d9-be9e-785d84f03a5d service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:08.267734 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-63478f9b-b546-4660-9ccb-16948497dabc req-2670f2e1-a883-46d9-be9e-785d84f03a5d service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:08.279695 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-63478f9b-b546-4660-9ccb-16948497dabc req-2670f2e1-a883-46d9-be9e-785d84f03a5d service nova] Creating event network-changed:84959274-d5ae-4d69-b800-e59f99fc83a8 for instance 893f39eb-39b0-459b-b5a6-53da3ff61552 on hv-cinder-84773 Jul 12 04:06:08.285078 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-63478f9b-b546-4660-9ccb-16948497dabc req-2670f2e1-a883-46d9-be9e-785d84f03a5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035002 Jul 12 04:06:08.286076 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 579/1196] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:06:09.024922 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-675431e5-44a2-4da2-9f7b-87f3809a8e3a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:09.025819 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-675431e5-44a2-4da2-9f7b-87f3809a8e3a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:09.037340 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-675431e5-44a2-4da2-9f7b-87f3809a8e3a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:09.038083 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-675431e5-44a2-4da2-9f7b-87f3809a8e3a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:09.039328 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-675431e5-44a2-4da2-9f7b-87f3809a8e3a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:09.040161 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-675431e5-44a2-4da2-9f7b-87f3809a8e3a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:09.177626 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-675431e5-44a2-4da2-9f7b-87f3809a8e3a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:06:09.185367 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-675431e5-44a2-4da2-9f7b-87f3809a8e3a tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1367 microversion: 2.1 time: 0.167084 Jul 12 04:06:09.185929 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 618/1197] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:09 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:10.213247 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-7c9ecd1c-c113-4399-bc90-80b015527a20 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:10.214396 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-7c9ecd1c-c113-4399-bc90-80b015527a20 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:10.225291 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c9ecd1c-c113-4399-bc90-80b015527a20 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:10.225935 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c9ecd1c-c113-4399-bc90-80b015527a20 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:10.227324 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c9ecd1c-c113-4399-bc90-80b015527a20 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:10.228089 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-7c9ecd1c-c113-4399-bc90-80b015527a20 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:10.385678 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-7c9ecd1c-c113-4399-bc90-80b015527a20 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:06:10.394375 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-7c9ecd1c-c113-4399-bc90-80b015527a20 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1367 microversion: 2.1 time: 0.189126 Jul 12 04:06:10.394950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 580/1198] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:10 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:11.411286 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-657f7772-1e3f-4eae-9977-0cb5cdf001d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:11.411894 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-657f7772-1e3f-4eae-9977-0cb5cdf001d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:11.418899 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-657f7772-1e3f-4eae-9977-0cb5cdf001d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:11.419355 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-657f7772-1e3f-4eae-9977-0cb5cdf001d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:11.420161 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-657f7772-1e3f-4eae-9977-0cb5cdf001d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:11.420599 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-657f7772-1e3f-4eae-9977-0cb5cdf001d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:11.553411 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-657f7772-1e3f-4eae-9977-0cb5cdf001d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:06:11.561307 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-657f7772-1e3f-4eae-9977-0cb5cdf001d0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1367 microversion: 2.1 time: 0.154320 Jul 12 04:06:11.561886 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 619/1199] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:11 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:12.580491 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-a5f5a3ec-3c02-48da-802d-3b7b4c1dee91 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:12.581227 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-a5f5a3ec-3c02-48da-802d-3b7b4c1dee91 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:12.589735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a5f5a3ec-3c02-48da-802d-3b7b4c1dee91 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:12.590302 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a5f5a3ec-3c02-48da-802d-3b7b4c1dee91 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:12.591342 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a5f5a3ec-3c02-48da-802d-3b7b4c1dee91 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:12.591889 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-a5f5a3ec-3c02-48da-802d-3b7b4c1dee91 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:12.757354 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-a5f5a3ec-3c02-48da-802d-3b7b4c1dee91 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:06:12.765072 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-a5f5a3ec-3c02-48da-802d-3b7b4c1dee91 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1367 microversion: 2.1 time: 0.189638 Jul 12 04:06:12.765626 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 581/1200] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:12 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:13.781945 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ae8861d0-9b87-4708-844c-a1d2d9a25b71 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:13.782594 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ae8861d0-9b87-4708-844c-a1d2d9a25b71 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:13.790494 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ae8861d0-9b87-4708-844c-a1d2d9a25b71 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:13.790926 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ae8861d0-9b87-4708-844c-a1d2d9a25b71 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:13.791796 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ae8861d0-9b87-4708-844c-a1d2d9a25b71 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:13.792275 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ae8861d0-9b87-4708-844c-a1d2d9a25b71 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:13.936866 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ae8861d0-9b87-4708-844c-a1d2d9a25b71 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:06:13.944619 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ae8861d0-9b87-4708-844c-a1d2d9a25b71 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1367 microversion: 2.1 time: 0.166756 Jul 12 04:06:13.945180 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 620/1201] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:13 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:14.324620 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-b135110a-fc83-45ca-9988-cb3005dd582a req-4d2d071d-8bb1-45e2-b1e9-aa393cef982d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893f39eb-39b0-459b-b5a6-53da3ff61552", "name": "network-vif-plugged", "status": "completed", "tag": "84959274-d5ae-4d69-b800-e59f99fc83a8"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:06:14.333675 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-b135110a-fc83-45ca-9988-cb3005dd582a req-4d2d071d-8bb1-45e2-b1e9-aa393cef982d service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:14.334155 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-b135110a-fc83-45ca-9988-cb3005dd582a req-4d2d071d-8bb1-45e2-b1e9-aa393cef982d service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:14.345501 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-b135110a-fc83-45ca-9988-cb3005dd582a req-4d2d071d-8bb1-45e2-b1e9-aa393cef982d service nova] Creating event network-vif-plugged:84959274-d5ae-4d69-b800-e59f99fc83a8 for instance 893f39eb-39b0-459b-b5a6-53da3ff61552 on hv-cinder-84773 Jul 12 04:06:14.350564 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-b135110a-fc83-45ca-9988-cb3005dd582a req-4d2d071d-8bb1-45e2-b1e9-aa393cef982d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029779 Jul 12 04:06:14.351160 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 582/1202] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 04:06:14.963438 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ae137bf5-3552-47cc-9d29-11df88fb70ad tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:14.964366 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ae137bf5-3552-47cc-9d29-11df88fb70ad tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:14.973029 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ae137bf5-3552-47cc-9d29-11df88fb70ad tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:14.973589 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ae137bf5-3552-47cc-9d29-11df88fb70ad tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:14.974558 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ae137bf5-3552-47cc-9d29-11df88fb70ad tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:14.975118 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ae137bf5-3552-47cc-9d29-11df88fb70ad tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:15.108031 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-ae137bf5-3552-47cc-9d29-11df88fb70ad tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:06:15.116164 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ae137bf5-3552-47cc-9d29-11df88fb70ad tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1367 microversion: 2.1 time: 0.157706 Jul 12 04:06:15.116743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 621/1203] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:14 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:16.131613 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=2 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:06:16.132455 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell0:SELECT=6 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:06:16.137030 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d359d679-23a2-42d0-81f6-6321e96e871c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:16.137872 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d359d679-23a2-42d0-81f6-6321e96e871c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:16.145924 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d359d679-23a2-42d0-81f6-6321e96e871c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:16.146376 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d359d679-23a2-42d0-81f6-6321e96e871c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:16.147149 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d359d679-23a2-42d0-81f6-6321e96e871c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:16.147595 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d359d679-23a2-42d0-81f6-6321e96e871c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:16.301911 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-d359d679-23a2-42d0-81f6-6321e96e871c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:06:16.309730 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d359d679-23a2-42d0-81f6-6321e96e871c tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1558 microversion: 2.1 time: 0.179636 Jul 12 04:06:16.310795 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 583/1204] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:06:16 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:06:16.326331 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-53dfd4e1-f4ac-4efc-857f-c3b3b518ef3b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:06:16.326825 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-53dfd4e1-f4ac-4efc-857f-c3b3b518ef3b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:06:16.328763 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell0:SELECT=6 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:06:16.334920 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-53dfd4e1-f4ac-4efc-857f-c3b3b518ef3b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:16.335365 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-53dfd4e1-f4ac-4efc-857f-c3b3b518ef3b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:16.336158 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-53dfd4e1-f4ac-4efc-857f-c3b3b518ef3b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:16.336591 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-53dfd4e1-f4ac-4efc-857f-c3b3b518ef3b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:16.415315 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-53dfd4e1-f4ac-4efc-857f-c3b3b518ef3b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092634 Jul 12 04:06:16.416277 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 622/1205] 10.222.0.20 () {58 vars in 1274 bytes} [Tue Jul 12 04:06:16 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:06:17.360031 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-0f7d5a0f-0fce-41d4-9d5a-6968ab86886a req-abf74714-eeb0-42db-b528-60aaf84cd25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893f39eb-39b0-459b-b5a6-53da3ff61552", "tag": "84959274-d5ae-4d69-b800-e59f99fc83a8"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:06:17.368534 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-0f7d5a0f-0fce-41d4-9d5a-6968ab86886a req-abf74714-eeb0-42db-b528-60aaf84cd25e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:06:17.368971 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-0f7d5a0f-0fce-41d4-9d5a-6968ab86886a req-abf74714-eeb0-42db-b528-60aaf84cd25e service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:06:17.380633 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-0f7d5a0f-0fce-41d4-9d5a-6968ab86886a req-abf74714-eeb0-42db-b528-60aaf84cd25e service nova] Creating event network-changed:84959274-d5ae-4d69-b800-e59f99fc83a8 for instance 893f39eb-39b0-459b-b5a6-53da3ff61552 on hv-cinder-84773 Jul 12 04:06:17.385833 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-0f7d5a0f-0fce-41d4-9d5a-6968ab86886a req-abf74714-eeb0-42db-b528-60aaf84cd25e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029730 Jul 12 04:06:17.386824 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 584/1206] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:07:32.647237 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:07:32.648571 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:07:32.656162 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-3507e96f-2620-4be0-aaf7-39e6884b8fae tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:32.656982 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-3507e96f-2620-4be0-aaf7-39e6884b8fae tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:32.669975 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3507e96f-2620-4be0-aaf7-39e6884b8fae tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:32.670713 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3507e96f-2620-4be0-aaf7-39e6884b8fae tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:32.671481 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3507e96f-2620-4be0-aaf7-39e6884b8fae tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:32.671920 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-3507e96f-2620-4be0-aaf7-39e6884b8fae tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:32.695933 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-3507e96f-2620-4be0-aaf7-39e6884b8fae tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552/ips" status: 200 len: 149 microversion: 2.1 time: 0.051981 Jul 12 04:07:32.696574 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 623/1207] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 04:07:32 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552/ips => generated 149 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:07:34.046379 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a33df332-27b0-4e9a-9c25-39249279b129] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 12 04:07:34.046992 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:07:34.047742 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG dbcounter [-] [124435] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:07:34.052822 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-0d6f592b-8712-4729-ba6e-104f78700196 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33b0d890-c667-4b09-b950-c12bd9b3397f"}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:07:34.053988 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-0d6f592b-8712-4729-ba6e-104f78700196 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:34.061592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0d6f592b-8712-4729-ba6e-104f78700196 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:34.062023 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0d6f592b-8712-4729-ba6e-104f78700196 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:34.062816 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0d6f592b-8712-4729-ba6e-104f78700196 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:34.063248 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-0d6f592b-8712-4729-ba6e-104f78700196 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:35.054953 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO oslo.messaging._drivers.impl_rabbit [-] [a33df332-27b0-4e9a-9c25-39249279b129] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46580. Jul 12 04:07:35.180751 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-0d6f592b-8712-4729-ba6e-104f78700196 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "POST /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.135907 Jul 12 04:07:35.181499 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 585/1208] 10.222.0.20 () {60 vars in 1322 bytes} [Tue Jul 12 04:07:34 2022] POST /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:07:37.285314 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:07:37.286191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Tue Jul 12 04:07:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 04:07:42.851604 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-bea50d74-53bd-436c-b57e-4a0b102e624b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:42.852288 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-bea50d74-53bd-436c-b57e-4a0b102e624b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:42.854564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_api:SELECT=2 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:07:42.855209 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG dbcounter [-] [124434] Writing DB stats nova_cell1:SELECT=4 {{(pid=124434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 04:07:42.861078 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bea50d74-53bd-436c-b57e-4a0b102e624b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:42.861526 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bea50d74-53bd-436c-b57e-4a0b102e624b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:42.862288 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bea50d74-53bd-436c-b57e-4a0b102e624b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:42.862717 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-bea50d74-53bd-436c-b57e-4a0b102e624b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:42.944815 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-bea50d74-53bd-436c-b57e-4a0b102e624b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lazy-loading 'services' on Instance uuid 893f39eb-39b0-459b-b5a6-53da3ff61552 {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 04:07:43.031117 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-bea50d74-53bd-436c-b57e-4a0b102e624b tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552/os-volume_attachments/33b0d890-c667-4b09-b950-c12bd9b3397f" status: 202 len: 0 microversion: 2.1 time: 0.182960 Jul 12 04:07:43.031942 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 624/1209] 10.222.0.20 () {58 vars in 1415 bytes} [Tue Jul 12 04:07:42 2022] DELETE /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552/os-volume_attachments/33b0d890-c667-4b09-b950-c12bd9b3397f => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 04:07:43.041583 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-da4faed6-82f9-4e42-b25f-6edef8f705e0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:43.042756 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-da4faed6-82f9-4e42-b25f-6edef8f705e0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:43.050960 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-da4faed6-82f9-4e42-b25f-6edef8f705e0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:43.051725 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-da4faed6-82f9-4e42-b25f-6edef8f705e0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:43.052508 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-da4faed6-82f9-4e42-b25f-6edef8f705e0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:43.052950 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-da4faed6-82f9-4e42-b25f-6edef8f705e0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:43.083508 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-da4faed6-82f9-4e42-b25f-6edef8f705e0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046303 Jul 12 04:07:43.084109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 586/1210] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 04:07:43 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:07:44.101077 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-c3497087-baac-49c0-aa8a-14ce69ee78e6 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:44.102829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-c3497087-baac-49c0-aa8a-14ce69ee78e6 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:44.113353 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c3497087-baac-49c0-aa8a-14ce69ee78e6 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:44.114085 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c3497087-baac-49c0-aa8a-14ce69ee78e6 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:44.115332 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c3497087-baac-49c0-aa8a-14ce69ee78e6 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:44.116069 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-c3497087-baac-49c0-aa8a-14ce69ee78e6 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:44.148923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-c3497087-baac-49c0-aa8a-14ce69ee78e6 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056056 Jul 12 04:07:44.149490 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 625/1211] 10.222.0.20 () {58 vars in 1301 bytes} [Tue Jul 12 04:07:44 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 04:07:44.206963 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-293b5491-7bec-45ad-984c-2521848adbe1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:44.207489 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-293b5491-7bec-45ad-984c-2521848adbe1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:44.215271 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-293b5491-7bec-45ad-984c-2521848adbe1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:44.215655 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-293b5491-7bec-45ad-984c-2521848adbe1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:44.216467 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-293b5491-7bec-45ad-984c-2521848adbe1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:44.216903 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-293b5491-7bec-45ad-984c-2521848adbe1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:44.244726 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-293b5491-7bec-45ad-984c-2521848adbe1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Going to try to terminate instance {{(pid=124435) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 04:07:44.329441 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-293b5491-7bec-45ad-984c-2521848adbe1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 204 len: 0 microversion: 2.1 time: 0.125927 Jul 12 04:07:44.330262 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 587/1212] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:07:44 2022] DELETE /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 04:07:44.338595 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-cd2b6dd4-7bd1-41cf-80f7-9f91fef43ce0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:44.339219 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-cd2b6dd4-7bd1-41cf-80f7-9f91fef43ce0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:44.345474 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd2b6dd4-7bd1-41cf-80f7-9f91fef43ce0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:44.345903 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd2b6dd4-7bd1-41cf-80f7-9f91fef43ce0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:44.346660 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd2b6dd4-7bd1-41cf-80f7-9f91fef43ce0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:44.347093 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-cd2b6dd4-7bd1-41cf-80f7-9f91fef43ce0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:44.486191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-cd2b6dd4-7bd1-41cf-80f7-9f91fef43ce0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:07:44.497817 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-cd2b6dd4-7bd1-41cf-80f7-9f91fef43ce0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1681 microversion: 2.1 time: 0.162919 Jul 12 04:07:44.498562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 626/1213] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:07:44 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:07:45.525668 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-f503ca72-9866-41a1-bf00-0baa62725595 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:45.526741 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-f503ca72-9866-41a1-bf00-0baa62725595 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:45.534999 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f503ca72-9866-41a1-bf00-0baa62725595 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:45.535458 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f503ca72-9866-41a1-bf00-0baa62725595 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:45.536247 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f503ca72-9866-41a1-bf00-0baa62725595 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:45.536675 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-f503ca72-9866-41a1-bf00-0baa62725595 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:45.670803 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.policy [None req-f503ca72-9866-41a1-bf00-0baa62725595 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124435) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:07:45.679369 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-f503ca72-9866-41a1-bf00-0baa62725595 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1681 microversion: 2.1 time: 0.161364 Jul 12 04:07:45.680269 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 588/1214] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:07:45 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:07:46.699880 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d756f952-6b70-4922-b6c9-252ea74f80a4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:46.700554 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-d756f952-6b70-4922-b6c9-252ea74f80a4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:46.707560 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d756f952-6b70-4922-b6c9-252ea74f80a4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:46.708022 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d756f952-6b70-4922-b6c9-252ea74f80a4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:46.708820 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d756f952-6b70-4922-b6c9-252ea74f80a4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:46.709247 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-d756f952-6b70-4922-b6c9-252ea74f80a4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:46.849699 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-d756f952-6b70-4922-b6c9-252ea74f80a4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:07:46.857362 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d756f952-6b70-4922-b6c9-252ea74f80a4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1681 microversion: 2.1 time: 0.161662 Jul 12 04:07:46.857974 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 627/1215] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:07:46 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:07:47.112958 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [req-19e89966-928c-464b-b50d-28dcf0da15bc req-80c91dff-a8d7-4a1d-a6dd-04bfbaa88ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893f39eb-39b0-459b-b5a6-53da3ff61552", "name": "network-vif-deleted", "tag": "84959274-d5ae-4d69-b800-e59f99fc83a8"}]} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:07:47.122271 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-19e89966-928c-464b-b50d-28dcf0da15bc req-80c91dff-a8d7-4a1d-a6dd-04bfbaa88ca2 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:47.122694 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [req-19e89966-928c-464b-b50d-28dcf0da15bc req-80c91dff-a8d7-4a1d-a6dd-04bfbaa88ca2 service nova] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:47.134664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.compute.server_external_events [req-19e89966-928c-464b-b50d-28dcf0da15bc req-80c91dff-a8d7-4a1d-a6dd-04bfbaa88ca2 service nova] Creating event network-vif-deleted:84959274-d5ae-4d69-b800-e59f99fc83a8 for instance 893f39eb-39b0-459b-b5a6-53da3ff61552 on hv-cinder-84773 Jul 12 04:07:47.139427 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [req-19e89966-928c-464b-b50d-28dcf0da15bc req-80c91dff-a8d7-4a1d-a6dd-04bfbaa88ca2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030225 Jul 12 04:07:47.140261 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 589/1216] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 12 04:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 04:07:47.875008 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-f44f8751-44a8-4250-8417-9eef7374ce02 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:47.875609 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-f44f8751-44a8-4250-8417-9eef7374ce02 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:47.882393 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f44f8751-44a8-4250-8417-9eef7374ce02 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:47.882814 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f44f8751-44a8-4250-8417-9eef7374ce02 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:47.883619 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f44f8751-44a8-4250-8417-9eef7374ce02 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:47.884052 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f44f8751-44a8-4250-8417-9eef7374ce02 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:47.920069 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f44f8751-44a8-4250-8417-9eef7374ce02 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:47.920582 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-f44f8751-44a8-4250-8417-9eef7374ce02 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:47.921116 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.objects.instance [None req-f44f8751-44a8-4250-8417-9eef7374ce02 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lazy-loading 'fault' on Instance uuid 893f39eb-39b0-459b-b5a6-53da3ff61552 {{(pid=124434) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 04:07:47.977481 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.policy [None req-f44f8751-44a8-4250-8417-9eef7374ce02 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0995483e7e7049bbb639ef3142192abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c29114118814a298f6337842ad29a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124434) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 04:07:47.984931 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-f44f8751-44a8-4250-8417-9eef7374ce02 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 200 len: 1331 microversion: 2.1 time: 0.113926 Jul 12 04:07:47.985550 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 628/1217] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:07:47 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 04:07:49.006360 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-95513210-8dba-4b20-aa2e-77def01124b1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:49.007427 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-95513210-8dba-4b20-aa2e-77def01124b1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:49.017622 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-95513210-8dba-4b20-aa2e-77def01124b1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:49.018364 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-95513210-8dba-4b20-aa2e-77def01124b1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:49.019558 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-95513210-8dba-4b20-aa2e-77def01124b1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:49.020280 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-95513210-8dba-4b20-aa2e-77def01124b1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:49.037707 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-95513210-8dba-4b20-aa2e-77def01124b1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-95513210-8dba-4b20-aa2e-77def01124b1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 HTTP/1.1 Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:07:49.039392 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:07:49.041158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:07:49.041158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:49.041158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:49.041158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:49.041158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:49.041158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:07:49.041158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:07:49.041158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:07:49.041158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:49.041158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:07:49.041158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:49.041158 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': '893f39eb-39b0-459b-b5a6-53da3ff61552'} Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:49.042185 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:49.043923 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:49.045444 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-95513210-8dba-4b20-aa2e-77def01124b1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 404 to user: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:49.045444 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-95513210-8dba-4b20-aa2e-77def01124b1 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 404 len: 111 microversion: 2.1 time: 0.042033 Jul 12 04:07:49.045444 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 590/1218] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:07:48 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:07:49.049967 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-d4589645-d51d-4f02-9b21-a9dd0a40bc53 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '.version_select at 0x7fd7fec529d0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:49.070035 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d4589645-d51d-4f02-9b21-a9dd0a40bc53 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-397210675" status: 202 len: 0 microversion: 2.1 time: 0.023875 Jul 12 04:07:49.070586 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 629/1219] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jul 12 04:07:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-397210675 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 04:07:50.819332 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d976f8ac-dea7-4978-90aa-0753cc0eda43 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:50.819843 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-d976f8ac-dea7-4978-90aa-0753cc0eda43 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:50.826809 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d976f8ac-dea7-4978-90aa-0753cc0eda43 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:50.827386 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d976f8ac-dea7-4978-90aa-0753cc0eda43 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:50.828025 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d976f8ac-dea7-4978-90aa-0753cc0eda43 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:50.828516 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-d976f8ac-dea7-4978-90aa-0753cc0eda43 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:50.842189 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-d976f8ac-dea7-4978-90aa-0753cc0eda43 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d976f8ac-dea7-4978-90aa-0753cc0eda43 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: DELETE /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 HTTP/1.1 Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:07:50.843830 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:07:50.845540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:07:50.845540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:50.845540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:50.845540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:50.845540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:50.845540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:07:50.845540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:07:50.845540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:07:50.845540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:50.845540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:07:50.845540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:50.845540 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': '893f39eb-39b0-459b-b5a6-53da3ff61552'} Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:50.846463 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:50.847777 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:50.849233 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-d976f8ac-dea7-4978-90aa-0753cc0eda43 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 404 to user: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:50.849233 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-d976f8ac-dea7-4978-90aa-0753cc0eda43 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 404 len: 111 microversion: 2.1 time: 0.029736 Jul 12 04:07:50.849440 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 591/1220] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:07:50 2022] DELETE /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:07:50.855119 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-66d30715-ab43-4acd-b5f2-da39e9dd2a04 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:50.855615 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-66d30715-ab43-4acd-b5f2-da39e9dd2a04 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: 893f39eb-39b0-459b-b5a6-53da3ff61552] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:50.863083 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66d30715-ab43-4acd-b5f2-da39e9dd2a04 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:50.863546 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66d30715-ab43-4acd-b5f2-da39e9dd2a04 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:50.864400 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66d30715-ab43-4acd-b5f2-da39e9dd2a04 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:50.864834 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-66d30715-ab43-4acd-b5f2-da39e9dd2a04 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:50.883430 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-66d30715-ab43-4acd-b5f2-da39e9dd2a04 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-66d30715-ab43-4acd-b5f2-da39e9dd2a04 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 HTTP/1.1 Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:07:50.885111 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:07:50.886564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:07:50.886564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:50.886564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:50.886564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:50.886564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:50.886564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:07:50.886564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:07:50.886564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:07:50.886564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:50.886564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:07:50.886564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:50.886564 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': '893f39eb-39b0-459b-b5a6-53da3ff61552'} Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:50.888504 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. Jul 12 04:07:50.889803 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:50.891045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-66d30715-ab43-4acd-b5f2-da39e9dd2a04 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 404 to user: Instance 893f39eb-39b0-459b-b5a6-53da3ff61552 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:50.891045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-66d30715-ab43-4acd-b5f2-da39e9dd2a04 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552" status: 404 len: 111 microversion: 2.1 time: 0.035969 Jul 12 04:07:50.891045 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 630/1221] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:07:50 2022] GET /compute/v2.1/servers/893f39eb-39b0-459b-b5a6-53da3ff61552 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:07:52.039973 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-28da24c1-baa5-4887-a2e9-2088a568fd86 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:52.040504 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-28da24c1-baa5-4887-a2e9-2088a568fd86 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:52.047592 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28da24c1-baa5-4887-a2e9-2088a568fd86 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:52.048044 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28da24c1-baa5-4887-a2e9-2088a568fd86 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:52.048846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28da24c1-baa5-4887-a2e9-2088a568fd86 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:52.049285 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-28da24c1-baa5-4887-a2e9-2088a568fd86 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:52.063351 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-28da24c1-baa5-4887-a2e9-2088a568fd86 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-28da24c1-baa5-4887-a2e9-2088a568fd86 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: DELETE /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc HTTP/1.1 Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:07:52.064975 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:07:52.066674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:07:52.066674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:52.066674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:52.066674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:52.066674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:52.066674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:07:52.066674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:07:52.066674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:07:52.066674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:52.066674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:07:52.066674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:07:52.066674 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'ee9465d1-1641-4116-9066-de2a7f75e8bc'} Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:52.067567 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:07:52.068983 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.070333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-28da24c1-baa5-4887-a2e9-2088a568fd86 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 404 to user: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:52.070333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-28da24c1-baa5-4887-a2e9-2088a568fd86 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 404 len: 111 microversion: 2.1 time: 0.030385 Jul 12 04:07:52.070333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 592/1222] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:07:52 2022] DELETE /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:07:52.074998 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-153258cd-0e17-42c1-b8ba-cbac4449b571 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:52.075612 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-153258cd-0e17-42c1-b8ba-cbac4449b571 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: ee9465d1-1641-4116-9066-de2a7f75e8bc] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:52.082444 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-153258cd-0e17-42c1-b8ba-cbac4449b571 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:52.082897 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-153258cd-0e17-42c1-b8ba-cbac4449b571 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:52.083651 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-153258cd-0e17-42c1-b8ba-cbac4449b571 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:52.084205 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-153258cd-0e17-42c1-b8ba-cbac4449b571 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:52.098289 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-153258cd-0e17-42c1-b8ba-cbac4449b571 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-153258cd-0e17-42c1-b8ba-cbac4449b571 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc HTTP/1.1 Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:07:52.099854 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:07:52.101577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:07:52.101577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:52.101577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:52.101577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:52.101577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:52.101577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:07:52.101577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:07:52.101577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:07:52.101577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:52.101577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:07:52.101577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:07:52.101577 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'ee9465d1-1641-4116-9066-de2a7f75e8bc'} Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:52.102434 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. Jul 12 04:07:52.103787 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.105089 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-153258cd-0e17-42c1-b8ba-cbac4449b571 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 404 to user: Instance ee9465d1-1641-4116-9066-de2a7f75e8bc could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:52.105089 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-153258cd-0e17-42c1-b8ba-cbac4449b571 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc" status: 404 len: 111 microversion: 2.1 time: 0.030127 Jul 12 04:07:52.105089 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 631/1223] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:07:52 2022] GET /compute/v2.1/servers/ee9465d1-1641-4116-9066-de2a7f75e8bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:07:52.112495 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-830959b8-3ab0-449b-b2ea-fa58223d2eb5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:52.113294 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-830959b8-3ab0-449b-b2ea-fa58223d2eb5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:52.123319 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-830959b8-3ab0-449b-b2ea-fa58223d2eb5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:52.124070 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-830959b8-3ab0-449b-b2ea-fa58223d2eb5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:52.125306 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-830959b8-3ab0-449b-b2ea-fa58223d2eb5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:52.125743 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-830959b8-3ab0-449b-b2ea-fa58223d2eb5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:52.139581 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-830959b8-3ab0-449b-b2ea-fa58223d2eb5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-830959b8-3ab0-449b-b2ea-fa58223d2eb5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: DELETE /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d HTTP/1.1 Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:07:52.141109 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:07:52.142748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:07:52.142748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:52.142748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:52.142748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:52.142748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:52.142748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:07:52.142748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:07:52.142748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:07:52.142748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:52.142748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:07:52.142748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:07:52.142748 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'c4b20034-9434-4ff8-b58b-1e1233ecfc8d'} Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:52.143689 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:07:52.145307 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.147247 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-830959b8-3ab0-449b-b2ea-fa58223d2eb5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 404 to user: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:52.147247 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-830959b8-3ab0-449b-b2ea-fa58223d2eb5 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 404 len: 111 microversion: 2.1 time: 0.036632 Jul 12 04:07:52.147247 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 593/1224] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:07:52 2022] DELETE /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 04:07:52.151502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ad220c7b-5f5b-4013-a579-67eb0c9a6f49 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:52.152211 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-ad220c7b-5f5b-4013-a579-67eb0c9a6f49 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: c4b20034-9434-4ff8-b58b-1e1233ecfc8d] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:52.158600 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ad220c7b-5f5b-4013-a579-67eb0c9a6f49 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:52.159044 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ad220c7b-5f5b-4013-a579-67eb0c9a6f49 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:52.159808 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ad220c7b-5f5b-4013-a579-67eb0c9a6f49 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:52.160281 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-ad220c7b-5f5b-4013-a579-67eb0c9a6f49 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:52.173973 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-ad220c7b-5f5b-4013-a579-67eb0c9a6f49 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ad220c7b-5f5b-4013-a579-67eb0c9a6f49 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d HTTP/1.1 Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:07:52.175502 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:07:52.177166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:07:52.177166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:52.177166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:52.177166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:52.177166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:52.177166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:07:52.177166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:07:52.177166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:07:52.177166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:52.177166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:07:52.177166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:07:52.177166 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'c4b20034-9434-4ff8-b58b-1e1233ecfc8d'} Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:52.178262 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. Jul 12 04:07:52.179829 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:52.183765 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-ad220c7b-5f5b-4013-a579-67eb0c9a6f49 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 404 to user: Instance c4b20034-9434-4ff8-b58b-1e1233ecfc8d could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:52.183765 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-ad220c7b-5f5b-4013-a579-67eb0c9a6f49 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d" status: 404 len: 111 microversion: 2.1 time: 0.029313 Jul 12 04:07:52.183765 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 632/1225] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:07:52 2022] GET /compute/v2.1/servers/c4b20034-9434-4ff8-b58b-1e1233ecfc8d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:07:53.332340 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2e6b8f14-9c7f-4787-a4ff-27e2da124cc4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:53.332882 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.compute.api [None req-2e6b8f14-9c7f-4787-a4ff-27e2da124cc4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124435) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:53.340693 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2e6b8f14-9c7f-4787-a4ff-27e2da124cc4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:53.341271 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2e6b8f14-9c7f-4787-a4ff-27e2da124cc4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:53.342145 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2e6b8f14-9c7f-4787-a4ff-27e2da124cc4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:53.342683 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG oslo_concurrency.lockutils [None req-2e6b8f14-9c7f-4787-a4ff-27e2da124cc4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:53.356306 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-2e6b8f14-9c7f-4787-a4ff-27e2da124cc4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2e6b8f14-9c7f-4787-a4ff-27e2da124cc4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: DELETE /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 HTTP/1.1 Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:07:53.357846 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:07:53.359486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:07:53.359486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:53.359486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:53.359486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:53.359486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:53.359486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:07:53.359486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:07:53.359486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:07:53.359486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:53.359486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: > Jul 12 04:07:53.359486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:07:53.359486 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'a87f737c-428c-4c33-9622-1cb03773adf4'} Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:53.360644 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:07:53.362466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:53.365466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-2e6b8f14-9c7f-4787-a4ff-27e2da124cc4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 404 to user: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:53.365466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-2e6b8f14-9c7f-4787-a4ff-27e2da124cc4 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 404 len: 111 microversion: 2.1 time: 0.033041 Jul 12 04:07:53.365466 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 594/1226] 10.222.0.20 () {58 vars in 1238 bytes} [Tue Jul 12 04:07:53 2022] DELETE /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:07:53.369843 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-287cd33b-9263-4a32-a2a8-c9c784f469f0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Calling method '>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:53.371057 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.compute.api [None req-287cd33b-9263-4a32-a2a8-c9c784f469f0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] [instance: a87f737c-428c-4c33-9622-1cb03773adf4] Fetching instance by UUID {{(pid=124434) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 04:07:53.379225 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-287cd33b-9263-4a32-a2a8-c9c784f469f0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:53.379652 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-287cd33b-9263-4a32-a2a8-c9c784f469f0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:53.380452 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-287cd33b-9263-4a32-a2a8-c9c784f469f0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 04:07:53.380892 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG oslo_concurrency.lockutils [None req-287cd33b-9263-4a32-a2a8-c9c784f469f0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Lock "05249ef8-00dc-42ee-b5c1-239ad6b1d9f7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124434) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 04:07:53.395268 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-287cd33b-9263-4a32-a2a8-c9c784f469f0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] HTTP exception thrown: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-287cd33b-9263-4a32-a2a8-c9c784f469f0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Request method failure captured: Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 HTTP/1.1 Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizPHRWJ9gvVoFFM8gsXIcsTqxZKAI5Up2v34ohAWinOAs6KDTAyhu-4tWvJCkCB8DvClL85BwojWBnZEvTv-ex_mMCgI7s3gCrcqNkc1UsuZow9d4zwaxA1_KosanKpyVAYx76zHCwzW9MWzmu7uIx4ShwnS6zlgG_VBxFXjl1QVD4l8 Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:07:53.397226 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:07:53.398800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5c29114118814a298f6337842ad29a9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5c29114118814a298f6337842ad29a9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5c29114118814a298f6337842ad29a9b"}]}] Jul 12 04:07:53.398800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:53.398800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 5c29114118814a298f6337842ad29a9b Jul 12 04:07:53.398800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1945946996 Jul 12 04:07:53.398800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:53.398800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:07:53.398800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:07:53.398800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 0995483e7e7049bbb639ef3142192abe Jul 12 04:07:53.398800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-AttachVolumeNegativeTest-1945946996-project Jul 12 04:07:53.398800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: > Jul 12 04:07:53.398800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:07:53.398800 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'a87f737c-428c-4c33-9622-1cb03773adf4'} Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:53.399633 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. Jul 12 04:07:53.401091 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:53.402333 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-287cd33b-9263-4a32-a2a8-c9c784f469f0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] Returning 404 to user: Instance a87f737c-428c-4c33-9622-1cb03773adf4 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:53.402333 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-287cd33b-9263-4a32-a2a8-c9c784f469f0 tempest-AttachVolumeNegativeTest-1945946996 tempest-AttachVolumeNegativeTest-1945946996-project] 10.222.0.20 "GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4" status: 404 len: 111 microversion: 2.1 time: 0.034604 Jul 12 04:07:53.402333 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 633/1227] 10.222.0.20 () {58 vars in 1235 bytes} [Tue Jul 12 04:07:53 2022] GET /compute/v2.1/servers/a87f737c-428c-4c33-9622-1cb03773adf4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:07:58.030179 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-79a07ba7-9511-4d77-95e6-717d47972a4b tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Action: 'create', calling method: .version_select at 0x7fd7faec8a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-573431448", "metadata": {"Type": "work"}}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-79a07ba7-9511-4d77-95e6-717d47972a4b tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Request method failure captured: Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 121 Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPOdIU5zqOY8NdDmtQ9LW820Ue6VjDZ2EWsKE_759CtdJjvha18qGeA22gBi_ccBwaDyNVmJKi3m79oGCNjuiQG9rzodyqCJL5KHwmaz7N5HnquBHA__uXZ2IuU0CYPh76hy3A8NnObusJqLSOeLlAlkNmLYI1QkxDSQ37T_-FPHG48 Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 2da9c016d50e4a38a5ad1f2734240b2a Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:07:58.054082 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2da9c016d50e4a38a5ad1f2734240b2a"}]}] Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 2da9c016d50e4a38a5ad1f2734240b2a Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-VolumesNegativeTest-176563777-project Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 92e9abf6d1f447bcac5450c0970515df Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-VolumesNegativeTest-176563777-project Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-573431448", "metadata": {"Type": "work"}}} Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: Jul 12 04:07:58.055828 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-573431448', 'metadata': {'Type': 'work'}}}} Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise error Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:58.056956 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 04:07:58.058735 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 04:07:58.060333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 04:07:58.060333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.060333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-79a07ba7-9511-4d77-95e6-717d47972a4b tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:58.060333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-79a07ba7-9511-4d77-95e6-717d47972a4b tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.146455 Jul 12 04:07:58.060333 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 595/1228] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 12 04:07:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 04:07:58.067699 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6872b28c-c674-4666-a7a3-fc9448fa97c8 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Action: 'create', calling method: .version_select at 0x7fd7fec13940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2137048851", "metadata": {"Type": "work"}}} {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6872b28c-c674-4666-a7a3-fc9448fa97c8 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Request method failure captured: Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 120 Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizPOdIU5zqOY8NdDmtQ9LW820Ue6VjDZ2EWsKE_759CtdJjvha18qGeA22gBi_ccBwaDyNVmJKi3m79oGCNjuiQG9rzodyqCJL5KHwmaz7N5HnquBHA__uXZ2IuU0CYPh76hy3A8NnObusJqLSOeLlAlkNmLYI1QkxDSQ37T_-FPHG48 Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 2da9c016d50e4a38a5ad1f2734240b2a Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:07:58.071913 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2da9c016d50e4a38a5ad1f2734240b2a"}]}] Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 2da9c016d50e4a38a5ad1f2734240b2a Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-VolumesNegativeTest-176563777-project Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 92e9abf6d1f447bcac5450c0970515df Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-VolumesNegativeTest-176563777-project Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2137048851", "metadata": {"Type": "work"}}} Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: Jul 12 04:07:58.073691 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2137048851', 'metadata': {'Type': 'work'}}}} Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise error Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi '0' Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:58.074762 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 04:07:58.076551 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 04:07:58.077890 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 04:07:58.077890 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.077890 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-6872b28c-c674-4666-a7a3-fc9448fa97c8 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:58.077890 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-6872b28c-c674-4666-a7a3-fc9448fa97c8 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009847 Jul 12 04:07:58.077890 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 634/1229] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 12 04:07:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 04:07:58.083458 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6ed0b30a-0fa3-47db-bf76-57b887875abf tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Action: 'create', calling method: .version_select at 0x7fd7fa535310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1340577595", "metadata": {"Type": "work"}}} {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6ed0b30a-0fa3-47db-bf76-57b887875abf tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Request method failure captured: Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 119 Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPOdIU5zqOY8NdDmtQ9LW820Ue6VjDZ2EWsKE_759CtdJjvha18qGeA22gBi_ccBwaDyNVmJKi3m79oGCNjuiQG9rzodyqCJL5KHwmaz7N5HnquBHA__uXZ2IuU0CYPh76hy3A8NnObusJqLSOeLlAlkNmLYI1QkxDSQ37T_-FPHG48 Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 2da9c016d50e4a38a5ad1f2734240b2a Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:07:58.086792 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2da9c016d50e4a38a5ad1f2734240b2a"}]}] Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 2da9c016d50e4a38a5ad1f2734240b2a Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-VolumesNegativeTest-176563777-project Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 92e9abf6d1f447bcac5450c0970515df Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-VolumesNegativeTest-176563777-project Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1340577595", "metadata": {"Type": "work"}}} Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: Jul 12 04:07:58.088664 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1340577595', 'metadata': {'Type': 'work'}}}} Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise error Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi '' Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:58.089853 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 04:07:58.091543 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 04:07:58.093088 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 04:07:58.093088 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.093088 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-6ed0b30a-0fa3-47db-bf76-57b887875abf tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:58.093088 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-6ed0b30a-0fa3-47db-bf76-57b887875abf tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008569 Jul 12 04:07:58.093088 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 596/1230] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 12 04:07:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 04:07:58.097827 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e34e814f-bbeb-4bb9-b700-5d66fce2d2f7 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Calling method '.version_select at 0x7fd7fec244c0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:58.127350 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-e34e814f-bbeb-4bb9-b700-5d66fce2d2f7 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] HTTP exception thrown: Volume tempest-invalid-2037502308 could not be found. Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e34e814f-bbeb-4bb9-b700-5d66fce2d2f7 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Request method failure captured: Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2037502308 HTTP/1.1 Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizPOdIU5zqOY8NdDmtQ9LW820Ue6VjDZ2EWsKE_759CtdJjvha18qGeA22gBi_ccBwaDyNVmJKi3m79oGCNjuiQG9rzodyqCJL5KHwmaz7N5HnquBHA__uXZ2IuU0CYPh76hy3A8NnObusJqLSOeLlAlkNmLYI1QkxDSQ37T_-FPHG48 Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 2da9c016d50e4a38a5ad1f2734240b2a Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:07:58.129395 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2da9c016d50e4a38a5ad1f2734240b2a"}]}] Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 2da9c016d50e4a38a5ad1f2734240b2a Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-VolumesNegativeTest-176563777-project Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 92e9abf6d1f447bcac5450c0970515df Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-VolumesNegativeTest-176563777-project Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Volume tempest-invalid-2037502308 could not be found. Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': 'tempest-invalid-2037502308'} Jul 12 04:07:58.131100 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2037502308 could not be found. (HTTP 404) (Request-ID: req-722979fc-b749-46f9-84e7-d9cc9747605b) Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.132191 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 04:07:58.133743 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2037502308 could not be found. Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:07:58.135255 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2037502308 could not be found. Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2037502308 could not be found. Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-e34e814f-bbeb-4bb9-b700-5d66fce2d2f7 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Returning 404 to user: Volume tempest-invalid-2037502308 could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-e34e814f-bbeb-4bb9-b700-5d66fce2d2f7 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2037502308" status: 404 len: 99 microversion: 2.1 time: 0.037389 Jul 12 04:07:58.136923 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 635/1231] 10.222.0.20 () {58 vars in 1217 bytes} [Tue Jul 12 04:07:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2037502308 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 04:07:58.141243 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-71c53841-0c6e-4441-b96c-0478ae85d8fd tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003802 Jul 12 04:07:58.141787 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 597/1232] 10.222.0.20 () {58 vars in 1139 bytes} [Tue Jul 12 04:07:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 04:07:58.150568 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-d3d53d78-d8b7-4a84-9e76-55359e8ddc2a tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004243 Jul 12 04:07:58.151105 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 636/1233] 10.222.0.20 () {58 vars in 1136 bytes} [Tue Jul 12 04:07:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 12 04:07:58.160023 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-db86380a-8cf0-4583-abfa-df3efbba79a5 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Calling method '.version_select at 0x7fd7faee3a60>' {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:58.195286 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.wsgi [None req-db86380a-8cf0-4583-abfa-df3efbba79a5 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] HTTP exception thrown: Volume f90dbe4d-8af9-4050-a2d1-c3c1a024826a could not be found. Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-db86380a-8cf0-4583-abfa-df3efbba79a5 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Request method failure captured: Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: request: DELETE /compute/v2.1/os-volumes/f90dbe4d-8af9-4050-a2d1-c3c1a024826a HTTP/1.1 Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept: application/json Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Accept-Encoding: identity Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Connection: close Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Length: 0 Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Content-Type: application/json Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Host: 10.222.0.20 Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Openstack-System-Scope: None Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Auth-Token: gAAAAABizPOdIU5zqOY8NdDmtQ9LW820Ue6VjDZ2EWsKE_759CtdJjvha18qGeA22gBi_ccBwaDyNVmJKi3m79oGCNjuiQG9rzodyqCJL5KHwmaz7N5HnquBHA__uXZ2IuU0CYPh76hy3A8NnObusJqLSOeLlAlkNmLYI1QkxDSQ37T_-FPHG48 Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Id: None Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Domain-Name: None Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Identity-Status: Confirmed Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Is-Admin-Project: True Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Id: default Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Domain-Name: Default Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Id: 2da9c016d50e4a38a5ad1f2734240b2a Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Project-Name: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Role: member,reader Jul 12 04:07:58.197394 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Roles: member,reader Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2da9c016d50e4a38a5ad1f2734240b2a"}]}] Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Id: 2da9c016d50e4a38a5ad1f2734240b2a Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-Tenant-Name: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User: tempest-VolumesNegativeTest-176563777-project Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Id: default Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Domain-Name: Default Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Id: 92e9abf6d1f447bcac5450c0970515df Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: X-User-Name: tempest-VolumesNegativeTest-176563777-project Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: method: Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: exception: Volume f90dbe4d-8af9-4050-a2d1-c3c1a024826a could not be found. Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: action_args: {'id': 'f90dbe4d-8af9-4050-a2d1-c3c1a024826a'} Jul 12 04:07:58.199169 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: {{(pid=124435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f90dbe4d-8af9-4050-a2d1-c3c1a024826a could not be found. (HTTP 404) (Request-ID: req-661a92be-c28d-4ea8-a272-888f31f1d7ec) Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.200410 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 04:07:58.201891 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f90dbe4d-8af9-4050-a2d1-c3c1a024826a could not be found. Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 04:07:58.203464 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f90dbe4d-8af9-4050-a2d1-c3c1a024826a could not be found. Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f90dbe4d-8af9-4050-a2d1-c3c1a024826a could not be found. Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: DEBUG nova.api.openstack.wsgi [None req-db86380a-8cf0-4583-abfa-df3efbba79a5 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Returning 404 to user: Volume f90dbe4d-8af9-4050-a2d1-c3c1a024826a could not be found. {{(pid=124435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO nova.api.openstack.requestlog [None req-db86380a-8cf0-4583-abfa-df3efbba79a5 tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/f90dbe4d-8af9-4050-a2d1-c3c1a024826a" status: 404 len: 109 microversion: 2.1 time: 0.042916 Jul 12 04:07:58.205013 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: [pid: 124435|app: 0|req: 598/1234] 10.222.0.20 () {58 vars in 1247 bytes} [Tue Jul 12 04:07:58 2022] DELETE /compute/v2.1/os-volumes/f90dbe4d-8af9-4050-a2d1-c3c1a024826a => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:07:58.215767 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-90e971ed-0963-436b-b14a-c8661b7e18ed tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Calling method '.version_select at 0x7fd7fec133a0>' {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 04:07:58.245167 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.wsgi [None req-90e971ed-0963-436b-b14a-c8661b7e18ed tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] HTTP exception thrown: Volume 34c97091-2157-4273-a5e4-7c3b7c9ffccf could not be found. Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-90e971ed-0963-436b-b14a-c8661b7e18ed tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Request method failure captured: Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: request: GET /compute/v2.1/os-volumes/34c97091-2157-4273-a5e4-7c3b7c9ffccf HTTP/1.1 Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept: application/json Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Accept-Encoding: identity Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Connection: close Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Length: 0 Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Content-Type: application/json Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Host: 10.222.0.20 Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Openstack-System-Scope: None Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: User-Agent: python-urllib3/1.26.9 Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Auth-Token: gAAAAABizPOdIU5zqOY8NdDmtQ9LW820Ue6VjDZ2EWsKE_759CtdJjvha18qGeA22gBi_ccBwaDyNVmJKi3m79oGCNjuiQG9rzodyqCJL5KHwmaz7N5HnquBHA__uXZ2IuU0CYPh76hy3A8NnObusJqLSOeLlAlkNmLYI1QkxDSQ37T_-FPHG48 Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Id: None Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Domain-Name: None Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Identity-Status: Confirmed Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Is-Admin-Project: True Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Id: default Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Domain-Name: Default Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Id: 2da9c016d50e4a38a5ad1f2734240b2a Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Project-Name: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Role: member,reader Jul 12 04:07:58.247063 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Roles: member,reader Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2da9c016d50e4a38a5ad1f2734240b2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2da9c016d50e4a38a5ad1f2734240b2a"}]}] Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Id: 2da9c016d50e4a38a5ad1f2734240b2a Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-Tenant-Name: tempest-VolumesNegativeTest-176563777 Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User: tempest-VolumesNegativeTest-176563777-project Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Id: default Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Domain-Name: Default Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Id: 92e9abf6d1f447bcac5450c0970515df Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: X-User-Name: tempest-VolumesNegativeTest-176563777-project Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: method: Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: exception: Volume 34c97091-2157-4273-a5e4-7c3b7c9ffccf could not be found. Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: action_args: {'id': '34c97091-2157-4273-a5e4-7c3b7c9ffccf'} Jul 12 04:07:58.249068 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: {{(pid=124434) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34c97091-2157-4273-a5e4-7c3b7c9ffccf could not be found. (HTTP 404) (Request-ID: req-5ebf295e-66ae-43e8-9064-58167dfc4ffb) Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.250562 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 04:07:58.252110 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34c97091-2157-4273-a5e4-7c3b7c9ffccf could not be found. Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 04:07:58.253404 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34c97091-2157-4273-a5e4-7c3b7c9ffccf could not be found. Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34c97091-2157-4273-a5e4-7c3b7c9ffccf could not be found. Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: ERROR nova.api.openstack.wsgi Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: DEBUG nova.api.openstack.wsgi [None req-90e971ed-0963-436b-b14a-c8661b7e18ed tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] Returning 404 to user: Volume 34c97091-2157-4273-a5e4-7c3b7c9ffccf could not be found. {{(pid=124434) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO nova.api.openstack.requestlog [None req-90e971ed-0963-436b-b14a-c8661b7e18ed tempest-VolumesNegativeTest-176563777 tempest-VolumesNegativeTest-176563777-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/34c97091-2157-4273-a5e4-7c3b7c9ffccf" status: 404 len: 109 microversion: 2.1 time: 0.036582 Jul 12 04:07:58.254704 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: [pid: 124434|app: 0|req: 637/1235] 10.222.0.20 () {58 vars in 1244 bytes} [Tue Jul 12 04:07:58 2022] GET /compute/v2.1/os-volumes/34c97091-2157-4273-a5e4-7c3b7c9ffccf => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 04:09:16.991941 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:09:16.992479 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Tue Jul 12 04:09:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 04:09:17.333738 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:09:17.334062 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Tue Jul 12 04:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 04:09:56.486919 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:09:56.488153 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Tue Jul 12 04:09:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 04:10:57.300304 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:10:57.301013 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Tue Jul 12 04:10:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 04:10:58.563202 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:10:58.564145 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Tue Jul 12 04:10:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 04:12:37.001088 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:12:37.001966 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Tue Jul 12 04:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 04:12:37.343907 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:12:37.344377 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Tue Jul 12 04:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 04:12:49.981900 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:12:49.982432 dv-cinder-847730-4-iscsi devstack@n-api.service[124434]: Tue Jul 12 04:12:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 04:13:16.499332 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 04:13:16.500338 dv-cinder-847730-4-iscsi devstack@n-api.service[124435]: Tue Jul 12 04:13:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!